Sep 25 19:22:25 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 25 19:22:25 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 25 19:22:25 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 25 19:22:26 devstack cinder-volume[75953]: INFO dbcounter [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Registered counter for database cinder
Sep 25 19:22:26 devstack cinder-volume[75953]: DEBUG oslo_db.sqlalchemy.engines [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75953) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:22:27 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writer thread running {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 25 19:22:27 devstack cinder-volume[75953]: INFO cinder.rpc [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 19:22:27 devstack cinder-volume[75953]: INFO cinder.rpc [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 19:22:27 devstack cinder-volume[75953]: DEBUG oslo_db.sqlalchemy.engines [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75953) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:22:27 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Determined volume DB was empty at startup.
Sep 25 19:22:27 devstack cinder-volume[75953]: DEBUG cinder.volume.manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75953) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 25 19:22:27 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 19:22:27 devstack cinder-volume[75953]: WARNING stevedore.named [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 19:22:27 devstack cinder-volume[75953]: WARNING castellan.key_manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 19:22:27 devstack cinder-volume[75953]: WARNING cinder.keymgr.conf_key_mgr [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 19:22:27 devstack cinder-volume[75953]: DEBUG cinder.volume.drivers.lvm [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75953) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 25 19:22:27 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75953) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:28 devstack cinder-volume[75953]: DEBUG oslo_concurrency.processutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] CMD "cinder-rtstool verify" returned: 0 in 1.066s {{(pid=75953) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:28 devstack cinder-volume[75953]: DEBUG oslo_db.sqlalchemy.engines [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75953) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:22:28 devstack cinder-volume[75953]: INFO cinder.rpc [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 25 19:22:28 devstack cinder-volume[75953]: INFO cinder.rpc [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 25 19:22:28 devstack cinder-volume[75953]: WARNING stevedore.named [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 19:22:28 devstack cinder-volume[75953]: WARNING castellan.key_manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 19:22:29 devstack cinder-volume[75953]: INFO cinder.volume.manager [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_db.sqlalchemy.engines [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75953) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:22:29 devstack cinder-volume[75953]: INFO oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Starting 1 workers
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Started child 76101 {{(pid=75953) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Full set of CONF: {{(pid=75953) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] ******************************************************************************** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Configuration options gathered from: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] ================================================================================ {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] allow_availability_zone_fallback = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] allow_compression_on_image_upload = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] allowed_direct_url_schemes     = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] api_rate_limit                 = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] auth_strategy                  = keystone {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] az_cache_duration              = 3600 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_availability_zone      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_host                   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_name                   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_stats_polling_interval = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backup_api_class               = cinder.backup.api.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backup_name_template           = backup-%s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backup_use_same_host           = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backup_use_temp_snapshot       = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] chap_password                  = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] chap_username                  =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[76101]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_internal_tenant_project_id = 682e1a4ad04c485a9a30a634a376f311 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_internal_tenant_user_id = 393221a2482a44869c6ae9a20ade2b00 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cloned_volume_same_az          = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cluster                        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] compression_format             = gzip {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] config_dir                     = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] config_source                  = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] control_exchange               = openstack {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] debug                          = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] default_availability_zone      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] default_group_type             = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] default_volume_type            = lvmdriver-1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_client_cert             = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_client_cert_key         = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_data_namespace          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_ssl_cert_path           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_ssl_cert_verify         = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] driver_use_ssl                 = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] enable_force_upload            = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] enable_new_services            = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] enable_unsupported_driver      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] enforce_multipath_for_image_xfer = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] filter_function                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_api_insecure            = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_api_servers             = ['http://192.168.122.86/image'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_api_ssl_compression     = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_ca_certificates_file    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_certfile                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_keyfile                 = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_num_retries             = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance_request_timeout         = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] goodness_function              = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] graceful_shutdown_timeout      = 5 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] group_api_class                = cinder.group.api.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] host                           = devstack {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_compress_on_upload       = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_conversion_address_space_limit = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_conversion_cpu_limit     = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_conversion_disable       = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_upload_use_cinder_backend = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_upload_use_internal_tenant = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_volume_cache_enabled     = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_volume_cache_max_count   = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] image_volume_cache_max_size_gb = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] init_host_max_objects_retrieval = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iscsi_iotype                   = fileio {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iscsi_target_flags             =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iscsi_write_cache              = on {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iser_helper                    = tgtadm {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iser_ip_address                = 192.168.122.86 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iser_port                      = 3260 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_color                      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_config_append              = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_dir                        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_file                       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_options                    = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_rotate_interval            = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_rotate_interval_type       = days {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] log_rotation_type              = none {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] max_age                        = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] max_logfile_count              = 30 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] max_logfile_size_mb            = 200 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] max_over_subscription_ratio    = 20.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] message_reap_interval          = 86400 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] message_ttl                    = 2592000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] migration_create_volume_timeout_secs = 300 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] monkey_patch                   = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] monkey_patch_modules           = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] my_ip                          = 192.168.122.86 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] no_snapshot_gb_quota           = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] num_iser_scan_tries            = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] num_shell_tries                = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] num_volume_device_scan_tries   = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] nvmeof_conn_info_version       = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] nvmet_ns_id                    = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] nvmet_port_id                  = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_max_limit                = 1000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_ext_list          = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_listen_port       = 8776 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_use_ssl           = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] osapi_volume_workers           = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] per_volume_size_limit          = -1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] periodic_fuzzy_delay           = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] periodic_interval              = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] public_endpoint                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] publish_errors                 = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_backup_gigabytes         = 1000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_backups                  = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_gigabytes                = 1000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_groups                   = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_snapshots                = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] quota_volumes                  = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] rate_limit_burst               = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] rate_limit_except_level        = CRITICAL {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] rate_limit_interval            = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] reinit_driver_count            = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] replication_device             = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] report_discard_supported       = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] report_interval                = 120 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] reservation_clean_interval     = 86400 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] reservation_expire             = 86400 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] reserved_image_namespaces      = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] reserved_percentage            = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] rpc_response_timeout           = 120 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] run_external_periodic_tasks    = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] scst_target_driver             = iscsi {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] scst_target_iqn_name           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_down_time              = 720 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] shell_completion               = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] snapshot_name_template         = snapshot-%s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] snapshot_same_host             = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] split_loggers                  = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] state_path                     = /opt/stack/data/cinder {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] storage_availability_zone      = nova {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] storage_protocol               = iSCSI {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] syslog_log_facility            = LOG_USER {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_helper                  = lioadm {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_ip_address              = 192.168.122.86 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_port                    = 3260 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_protocol                = iscsi {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] target_secondary_ip_addresses  = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] trace_flags                    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] transport_url                  = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] until_refresh                  = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_chap_auth                  = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_default_quota_class        = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_journal                    = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_json                       = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_multipath_for_image_xfer   = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_stderr                     = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] use_syslog                     = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] verify_glance_signatures       = enabled {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_api_class               = cinder.volume.api.API {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_backend_name            = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_clear                   = zero {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_clear_ionice            = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_clear_size              = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_copy_bps_limit          = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_dd_blocksize            = 1M {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_name_template           = volume-%s {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_service_inithost_offload = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volume_usage_audit_period      = month {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] watch_log_file                 = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] zoning_mode                    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_concurrency.disable_process_locking = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.admin_password = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.admin_token = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.admin_user  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_protocol = https {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_section = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_type   = password {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_uri    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.auth_version = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.cache       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.certfile    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.identity_uri = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.include_service_catalog = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.insecure    = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.interface   = public {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.keyfile     = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_password =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcache_username =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.region_name = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.service_type = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.backend                  = dogpile.cache.null {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.backend_argument         = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.backend_expiration_time  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.config_prefix            = cache.oslo {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.dead_timeout             = 60.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.debug_cache_backend      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.enable_retry_client      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.enable_socket_keepalive  = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.enabled                  = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.enforce_fips_mode        = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.expiration_time          = 600 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.hashclient_retry_attempts = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_dead_retry      = 300 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_password        = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_sasl_enabled    = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.memcache_username        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.proxies                  = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_db                 = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_password           = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_server             = localhost:6379 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_socket_timeout     = 1.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.redis_username           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.retry_attempts           = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.retry_delay              = 0.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.socket_keepalive_count   = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.socket_keepalive_idle    = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.socket_keepalive_interval = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.tls_allowed_ciphers      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.tls_cafile               = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.tls_certfile             = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.tls_enabled              = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cache.tls_keyfile              = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] coordination.backend_url       = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.asyncio_connection    = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.asyncio_slave_connection = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.backend               = sqlalchemy {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.connection            = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.connection_debug      = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.connection_parameters =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.connection_recycle_time = 3600 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.connection_trace      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.db_inc_retry_interval = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.db_max_retries        = 20 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.db_max_retry_interval = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.db_retry_interval     = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.max_overflow          = 50 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.max_pool_size         = 5 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.max_retries           = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.mysql_wsrep_sync_wait = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.pool_timeout          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.retry_interval        = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.slave_connection      = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.sqlite_synchronous    = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] database.use_db_reconnect      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.connection_string     = messaging:// {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.enabled               = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.es_doc_type           = notification {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.es_scroll_size        = 10000 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.es_scroll_time        = 2m {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.filter_error_trace    = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.hmac_keys             = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.sentinel_service_name = mymaster {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.socket_timeout        = 0.1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.trace_requests        = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler.trace_sqlalchemy      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler_jaeger.process_tags   = {} {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler_jaeger.service_name_prefix = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] profiler_otlp.service_name_prefix = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.enforce_new_defaults = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: WARNING oslo_config.cfg [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.enforce_scope      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.policy_default_rule = default {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.group          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.helper_command = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] privsep_osbrick.user           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.group         = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.helper_command = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] cinder_sys_admin.user          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.auth_section      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.auth_type         = password {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.certfile          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.collect_timing    = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.insecure          = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.keyfile           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.send_service_user_token = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.split_loggers     = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] service_user.timeout           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.auth_section            = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.auth_type               = password {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.certfile                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.collect_timing          = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.insecure                = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.keyfile                 = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.split_loggers           = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] glance.timeout                 = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.backend_availability_zone = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.chap_password = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.chap_username =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_client_cert = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_client_cert_key = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_data_namespace = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.driver_use_ssl = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.extra_capabilities = {} {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.filter_function = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.goodness_function = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iscsi_target_flags =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iscsi_write_cache = on {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iser_ip_address = 192.168.122.86 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iser_port     = 3260 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.lvm_share_target = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.lvm_type      = auto {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.num_shell_tries = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.replication_device = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.report_discard_supported = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.reserved_percentage = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_helper = tgtadm {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.191s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_ip_address = 192.168.122.86 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_port   = 3260 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_protocol = iscsi {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.trace_flags   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.unique_fqdn_network = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.use_chap_auth = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_backend_name = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_clear  = zero {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_clear_ionice = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_clear_size = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_reports.file_event_handler = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_reports.log_dir           = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.backend_host       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.chap_password      = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.chap_username      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_client_cert = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.extra_capabilities = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.filter_function    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.goodness_function  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iser_helper        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iser_port          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.lvm_type           = auto {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.replication_device = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.report_discard_supported = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.reserved_percentage = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.scst_target_driver = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.storage_protocol   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:29 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_ip_address  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_port        = 3260 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.trace_flags        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_clear       = zero {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] lvmdriver-1.volumes_dir        = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_notifications.driver = [] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_notifications.retry = -1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] key_manager.fixed_key          = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.barbican_api_version  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.barbican_endpoint     = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.barbican_endpoint_type = public {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.barbican_region_name  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.cafile                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.certfile              = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.collect_timing        = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.insecure              = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.keyfile               = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.number_of_retries     = 60 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.retry_delay           = 1 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.118s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.send_service_user_token = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.split_loggers         = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.timeout               = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.verify_ssl            = True {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican.verify_ssl_path       = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.auth_section = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.auth_type = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.cafile   = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.certfile = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.collect_timing = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.insecure = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.keyfile  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.split_loggers = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] barbican_service_user.timeout  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.approle_role_id          = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.approle_secret_id        = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.kv_mountpoint            = secret {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.kv_path                  = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.kv_version               = 2 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.namespace                = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.root_token_id            = **** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.ssl_ca_crt_file          = None {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.timeout                  = 60.0 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.use_ssl                  = False {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:22:30 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] ******************************************************************************** {{(pid=75953) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 25 19:22:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.102s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:30 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:30 devstack sudo[76147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 25 19:22:30 devstack sudo[76147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:32 devstack sudo[76147]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:32 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:32 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:32 devstack sudo[76263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:32 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:34 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:34 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.989s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:34 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:22:34 devstack cinder-volume[76101]: INFO cinder.brick.local_dev.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 25 19:22:34 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:34 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.096s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:34 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:34 devstack sudo[76362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:22:34 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:36 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:36 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.020s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:36 devstack cinder-volume[76101]: DEBUG cinder.brick.local_dev.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76101) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 25 19:22:36 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:36 devstack sudo[76451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:36 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:39 devstack cinder-volume[75953]: DEBUG dbcounter [-] [75953] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75953) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:22:40 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:40 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.594s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:40 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:40 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.172s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:40 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:40 devstack sudo[76656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:40 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:42 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:42 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.136s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:42 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:42 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:42 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:42 devstack sudo[76697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 25 19:22:42 devstack sudo[76697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:44 devstack sudo[76697]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:44 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.326s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:44 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:45 devstack sudo[76733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:22:45 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:47 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:47 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.710s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:47 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:47 devstack sudo[76790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:22:47 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:50 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:51 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.270s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:51 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:51 devstack sudo[76828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:22:51 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:53 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:53 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.705s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:53 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:53 devstack sudo[76833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:53 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:56 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:56 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.391s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:56 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:56 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.101s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:56 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:56 devstack sudo[76843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:56 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:22:58 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root
Sep 25 19:22:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.665s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:59 devstack cinder-volume[76101]: INFO cinder.volume.drivers.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 25 19:22:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.065s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:22:59 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:22:59 devstack sudo[76957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:22:59 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:01 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:01 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.015s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:01 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:23:01 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:01 devstack sudo[77064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:23:01 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:03 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:03 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:03 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:03 devstack sudo[77101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:03 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:05 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.013s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:05 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:05 devstack sudo[77104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:23:05 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:07 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:07 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.011s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:07 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:07 devstack sudo[77109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:07 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:09 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.753s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:10 devstack cinder-volume[76101]: INFO cinder.volume.driver [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG cinder.volume.driver [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76101) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG oslo_db.sqlalchemy.engines [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writer thread running {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG cinder.db.sqlalchemy.api [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Building query based on filter {{(pid=76101) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG cinder.image.image_utils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76101) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 25 19:23:10 devstack cinder-volume[76101]: INFO cinder.keymgr.migration [None req-6e50a59d-4146-4e62-9051-a0e23f4647e3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:23:10 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:10 devstack sudo[77115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:23:10 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:12 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:12 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.988s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:12 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:12 devstack sudo[77201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:12 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:14 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.049s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:14 devstack sudo[77262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:23:14 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:16 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.408s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:17 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:17 devstack sudo[77266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:17 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:19 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.084s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:23:19 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Driver initialization completed successfully.
Sep 25 19:23:19 devstack cinder-volume[76101]: INFO cinder.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Initiating service 2 cleanup
Sep 25 19:23:19 devstack cinder-volume[76101]: INFO cinder.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Service 2 cleanup completed.
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG cinder.service [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Creating RPC server for service cinder-volume {{(pid=76101) start /opt/stack/cinder/cinder/service.py:239}}
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG cinder.service [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76101) start /opt/stack/cinder/cinder/service.py:245}}
Sep 25 19:23:19 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:23:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:19 devstack sudo[77269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:23:19 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:21 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.063s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:21 devstack sudo[77278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:21 devstack sudo[77278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:23 devstack sudo[77278]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.014s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:23 devstack sudo[77281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:23:23 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:25 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.052s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:25 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:23:25 devstack sudo[77288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:23:25 devstack sudo[77288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:23:27 devstack sudo[77288]: pam_unix(sudo:session): session closed for user root
Sep 25 19:23:27 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.835s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:23:27 devstack cinder-volume[76101]: INFO cinder.volume.manager [None req-3ec32cfd-ee4f-4ce5-a4f3-2339f1fdc8e0 None None] Driver post RPC initialization completed successfully.
Sep 25 19:23:29 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:23:37 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:24:14 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:24:14 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:24:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:24:15 devstack sudo[78282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:24:15 devstack sudo[78282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:24:17 devstack sudo[78282]: pam_unix(sudo:session): session closed for user root
Sep 25 19:24:17 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.105s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:24:17 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:24:17 devstack sudo[78285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:24:17 devstack sudo[78285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:24:19 devstack sudo[78285]: pam_unix(sudo:session): session closed for user root
Sep 25 19:24:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.074s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:24:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:24:19 devstack sudo[78288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:24:19 devstack sudo[78288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:24:21 devstack sudo[78288]: pam_unix(sudo:session): session closed for user root
Sep 25 19:24:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.345s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:24:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:24:21 devstack sudo[78352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:24:21 devstack sudo[78352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:24:23 devstack sudo[78352]: pam_unix(sudo:session): session closed for user root
Sep 25 19:24:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.025s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:24:23 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:25:14 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:25:14 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:25:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:25:15 devstack sudo[79195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:25:15 devstack sudo[79195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:25:16 devstack sudo[79195]: pam_unix(sudo:session): session closed for user root
Sep 25 19:25:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.945s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:25:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:25:16 devstack sudo[79198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:25:17 devstack sudo[79198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:25:19 devstack sudo[79198]: pam_unix(sudo:session): session closed for user root
Sep 25 19:25:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.356s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:25:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:25:19 devstack sudo[79287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:25:19 devstack sudo[79287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:25:21 devstack sudo[79287]: pam_unix(sudo:session): session closed for user root
Sep 25 19:25:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.039s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:25:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:25:21 devstack sudo[79318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:25:21 devstack sudo[79318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:25:23 devstack sudo[79318]: pam_unix(sudo:session): session closed for user root
Sep 25 19:25:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.909s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:25:23 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:25:38 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:26:14 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:26:14 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:26:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:26:15 devstack sudo[81402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:26:15 devstack sudo[81402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:26:17 devstack sudo[81402]: pam_unix(sudo:session): session closed for user root
Sep 25 19:26:17 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.212s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:26:17 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:26:17 devstack sudo[81561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:26:17 devstack sudo[81561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:26:19 devstack sudo[81561]: pam_unix(sudo:session): session closed for user root
Sep 25 19:26:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.267s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:26:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:26:19 devstack sudo[81713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:26:19 devstack sudo[81713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:26:21 devstack sudo[81713]: pam_unix(sudo:session): session closed for user root
Sep 25 19:26:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.024s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:26:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:26:21 devstack sudo[81863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:26:21 devstack sudo[81863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:26:23 devstack sudo[81863]: pam_unix(sudo:session): session closed for user root
Sep 25 19:26:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.947s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:26:23 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:27:14 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:27:14 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:27:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:27:15 devstack sudo[82571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:27:15 devstack sudo[82571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:27:16 devstack sudo[82571]: pam_unix(sudo:session): session closed for user root
Sep 25 19:27:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:27:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:27:17 devstack sudo[82576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:27:17 devstack sudo[82576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:27:19 devstack sudo[82576]: pam_unix(sudo:session): session closed for user root
Sep 25 19:27:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.188s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:27:19 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:27:19 devstack sudo[82583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:27:19 devstack sudo[82583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:27:21 devstack sudo[82583]: pam_unix(sudo:session): session closed for user root
Sep 25 19:27:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.206s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:27:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:27:21 devstack sudo[82593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:27:21 devstack sudo[82593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:27:23 devstack sudo[82593]: pam_unix(sudo:session): session closed for user root
Sep 25 19:27:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.850s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:27:23 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:27:38 devstack cinder-volume[76101]: DEBUG dbcounter [-] [76101] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76101) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:28:14 devstack cinder-volume[76101]: DEBUG oslo_service.periodic_task [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76101) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:28:14 devstack cinder-volume[76101]: DEBUG cinder.volume.drivers.lvm [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Updating volume stats {{(pid=76101) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 25 19:28:14 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:28:15 devstack sudo[82789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 19:28:15 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:28:16 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root
Sep 25 19:28:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.836s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:28:16 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:28:16 devstack sudo[82799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:28:16 devstack sudo[82799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:28:18 devstack sudo[82799]: pam_unix(sudo:session): session closed for user root
Sep 25 19:28:18 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.080s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:28:18 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:28:19 devstack sudo[82803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 19:28:19 devstack sudo[82803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:28:21 devstack sudo[82803]: pam_unix(sudo:session): session closed for user root
Sep 25 19:28:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.198s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:28:21 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:28:21 devstack sudo[82819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 19:28:21 devstack sudo[82819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:28:22 devstack sudo[82819]: pam_unix(sudo:session): session closed for user root
Sep 25 19:28:23 devstack cinder-volume[76101]: DEBUG oslo_concurrency.processutils [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.848s {{(pid=76101) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:28:23 devstack cinder-volume[76101]: DEBUG cinder.manager [None req-92318153-b35c-4b51-92f8-4683745cd030 None None] Notifying Schedulers of capabilities ... {{(pid=76101) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:29:01 devstack cinder-volume[75953]: INFO oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Caught SIGTERM, stopping children
Sep 25 19:29:01 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Acquiring lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 25 19:29:01 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Acquired lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 25 19:29:01 devstack cinder-volume[75953]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Releasing lock "singleton_lock" {{(pid=75953) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 25 19:29:01 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Stop services. {{(pid=75953) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 25 19:29:01 devstack cinder-volume[75953]: DEBUG oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Killing children. {{(pid=75953) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 25 19:29:01 devstack cinder-volume[75953]: INFO oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Waiting on 1 children to exit
Sep 25 19:29:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Acquiring lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 25 19:29:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Acquired lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 25 19:29:04 devstack cinder-volume[76101]: DEBUG oslo_concurrency.lockutils [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Releasing lock "singleton_lock" {{(pid=76101) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 25 19:29:04 devstack cinder-volume[76101]: WARNING amqp [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 19:29:04 devstack cinder-volume[76101]: WARNING amqp [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 19:29:04 devstack cinder-volume[75953]: INFO oslo_service.backend._eventlet.service [None req-83928dca-c32a-4c41-bdd3-db791ecdee85 None None] Child 76101 exited with status 0
Sep 25 19:29:23 devstack cinder-volume[83749]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83749) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 25 19:29:23 devstack cinder-volume[83749]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83749) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 25 19:29:23 devstack cinder-volume[83749]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83749) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO dbcounter [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Registered counter for database cinder
Sep 25 19:29:26 devstack cinder-volume[83749]: DEBUG oslo_db.sqlalchemy.engines [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83749) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:29:26 devstack cinder-volume[83749]: DEBUG dbcounter [-] [83749] Writer thread running {{(pid=83749) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO cinder.rpc [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO cinder.rpc [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 19:29:26 devstack cinder-volume[83749]: DEBUG oslo_db.sqlalchemy.engines [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83749) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO cinder.volume.manager [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Determined volume DB was empty at startup.
Sep 25 19:29:26 devstack cinder-volume[83749]: DEBUG cinder.volume.manager [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83749) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO cinder.volume.manager [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 19:29:26 devstack cinder-volume[83749]: WARNING stevedore.named [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 19:29:26 devstack cinder-volume[83749]: WARNING castellan.key_manager [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 19:29:26 devstack cinder-volume[83749]: WARNING cinder.keymgr.conf_key_mgr [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 19:29:26 devstack cinder-volume[83749]: INFO cinder.volume.manager [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 19:29:26 devstack cinder-volume[83749]: DEBUG oslo_db.sqlalchemy.engines [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83749) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:29:27 devstack cinder-volume[83749]: INFO oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Starting 1 workers
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Started child 83952 {{(pid=83749) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Full set of CONF: {{(pid=83749) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] ******************************************************************************** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Configuration options gathered from: {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 25 19:29:27 devstack cinder-volume[83952]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] ================================================================================ {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] allow_availability_zone_fallback = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] allow_compression_on_image_upload = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] allowed_direct_url_schemes     = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] api_rate_limit                 = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] auth_strategy                  = keystone {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_availability_zone      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_host                   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_name                   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_stats_polling_interval = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backup_api_class               = cinder.backup.api.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backup_name_template           = backup-%s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backup_use_same_host           = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backup_use_temp_snapshot       = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] chap_password                  = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] chap_username                  =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_internal_tenant_project_id = 682e1a4ad04c485a9a30a634a376f311 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_internal_tenant_user_id = 393221a2482a44869c6ae9a20ade2b00 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cluster                        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] compression_format             = gzip {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] compute_api_class              = cinder.compute.nova.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] config_dir                     = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] config_source                  = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] control_exchange               = openstack {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] debug                          = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] default_availability_zone      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] default_group_type             = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] default_volume_type            = QuobyteHD {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_client_cert             = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_client_cert_key         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_data_namespace          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_ssl_cert_path           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_ssl_cert_verify         = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] driver_use_ssl                 = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] enable_new_services            = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] enable_unsupported_driver      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] enabled_backends               = ['QuobyteHD'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] enforce_multipath_for_image_xfer = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] filter_function                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_api_insecure            = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_api_servers             = ['http://192.168.122.86/image'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_api_ssl_compression     = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_ca_certificates_file    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_catalog_info            = image:glance:publicURL {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_certfile                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_keyfile                 = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_num_retries             = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance_request_timeout         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] goodness_function              = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] graceful_shutdown_timeout      = 5 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] group_api_class                = cinder.group.api.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] host                           = devstack {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_compress_on_upload       = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_conversion_address_space_limit = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_conversion_cpu_limit     = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_conversion_disable       = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_upload_use_cinder_backend = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_upload_use_internal_tenant = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_volume_cache_enabled     = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_volume_cache_max_count   = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] image_volume_cache_max_size_gb = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] init_host_max_objects_retrieval = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] instance_format                = [instance: %(uuid)s]  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iscsi_iotype                   = fileio {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iscsi_target_flags             =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iscsi_write_cache              = on {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iser_helper                    = tgtadm {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iser_ip_address                = 192.168.122.86 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iser_port                      = 3260 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_color                      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_config_append              = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_dir                        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_file                       = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_options                    = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_rotate_interval            = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_rotate_interval_type       = days {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] log_rotation_type              = none {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] max_age                        = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] max_logfile_count              = 30 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] max_logfile_size_mb            = 200 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] max_over_subscription_ratio    = 20.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] message_reap_interval          = 86400 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] message_ttl                    = 2592000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] migration_create_volume_timeout_secs = 300 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] monkey_patch                   = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] monkey_patch_modules           = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] my_ip                          = 192.168.122.86 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] no_snapshot_gb_quota           = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] num_iser_scan_tries            = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] num_shell_tries                = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] num_volume_device_scan_tries   = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] nvmeof_conn_info_version       = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] nvmet_ns_id                    = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] nvmet_port_id                  = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_max_limit                = 1000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_ext_list          = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_listen_port       = 8776 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_use_ssl           = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] osapi_volume_workers           = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] per_volume_size_limit          = -1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] periodic_fuzzy_delay           = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] periodic_interval              = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] public_endpoint                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] publish_errors                 = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_backup_gigabytes         = 1000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_backups                  = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_gigabytes                = 1000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_groups                   = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_snapshots                = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] quota_volumes                  = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] rate_limit_burst               = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] rate_limit_except_level        = CRITICAL {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] rate_limit_interval            = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] reinit_driver_count            = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] replication_device             = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] report_discard_supported       = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] report_interval                = 120 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] reservation_clean_interval     = 86400 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] reservation_expire             = 86400 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] reserved_image_namespaces      = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] reserved_percentage            = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] rpc_response_timeout           = 120 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] run_external_periodic_tasks    = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] scst_target_driver             = iscsi {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] scst_target_iqn_name           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_down_time              = 720 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] shell_completion               = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] snapshot_name_template         = snapshot-%s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] split_loggers                  = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] state_path                     = /opt/stack/data/cinder {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] storage_availability_zone      = nova {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] storage_protocol               = iSCSI {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] syslog_log_facility            = LOG_USER {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_helper                  = lioadm {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_ip_address              = 192.168.122.86 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_port                    = 3260 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_protocol                = iscsi {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] target_secondary_ip_addresses  = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] trace_flags                    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] transport_url                  = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] until_refresh                  = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_chap_auth                  = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_default_quota_class        = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_journal                    = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_json                       = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_multipath_for_image_xfer   = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_stderr                     = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] use_syslog                     = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] verify_glance_signatures       = enabled {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_api_class               = cinder.volume.api.API {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_backend_name            = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_clear                   = zero {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_clear_ionice            = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_clear_size              = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_copy_bps_limit          = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_dd_blocksize            = 1M {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_name_template           = volume-%s {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_service_inithost_offload = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volume_usage_audit_period      = month {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] watch_log_file                 = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] zoning_mode                    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_concurrency.disable_process_locking = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.admin_password = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.admin_token = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.admin_user  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_port   = 35357 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_protocol = https {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_section = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_type   = password {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_uri    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.auth_version = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.cache       = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.certfile    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.identity_uri = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.include_service_catalog = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.insecure    = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.interface   = public {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.keyfile     = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_password =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcache_username =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.region_name = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.service_type = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.backend                  = dogpile.cache.null {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.backend_argument         = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.backend_expiration_time  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.config_prefix            = cache.oslo {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.dead_timeout             = 60.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.debug_cache_backend      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.enable_retry_client      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.enable_socket_keepalive  = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.enabled                  = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.enforce_fips_mode        = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.expiration_time          = 600 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.hashclient_retry_attempts = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_dead_retry      = 300 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_password        = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_pool_maxsize    = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_sasl_enabled    = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.memcache_username        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.proxies                  = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_db                 = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_password           = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_server             = localhost:6379 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_socket_timeout     = 1.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.redis_username           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.retry_attempts           = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.retry_delay              = 0.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.socket_keepalive_count   = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.socket_keepalive_idle    = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.socket_keepalive_interval = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83952) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.tls_allowed_ciphers      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.tls_cafile               = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.tls_certfile             = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.tls_enabled              = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cache.tls_keyfile              = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] coordination.backend_url       = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.asyncio_connection    = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.asyncio_slave_connection = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.backend               = sqlalchemy {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.connection            = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.connection_debug      = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.connection_parameters =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.connection_recycle_time = 3600 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.connection_trace      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.db_inc_retry_interval = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.db_max_retries        = 20 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.db_max_retry_interval = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.db_retry_interval     = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.max_overflow          = 50 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.max_pool_size         = 5 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.max_retries           = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.mysql_wsrep_sync_wait = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.pool_timeout          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.retry_interval        = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.slave_connection      = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.sqlite_synchronous    = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] database.use_db_reconnect      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.connection_string     = messaging:// {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.enabled               = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.es_doc_type           = notification {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.es_scroll_size        = 10000 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.es_scroll_time        = 2m {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.filter_error_trace    = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.hmac_keys             = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.sentinel_service_name = mymaster {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.socket_timeout        = 0.1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.trace_requests        = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler.trace_sqlalchemy      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler_jaeger.process_tags   = {} {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler_jaeger.service_name_prefix = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] profiler_otlp.service_name_prefix = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.enforce_new_defaults = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: WARNING oslo_config.cfg [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.enforce_scope      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.policy_default_rule = default {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.policy_file        = policy.yaml {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.group          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.helper_command = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] privsep_osbrick.user           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.group         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.helper_command = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] cinder_sys_admin.user          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.auth_section      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.auth_type         = password {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.certfile          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.collect_timing    = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.insecure          = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.keyfile           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.send_service_user_token = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.split_loggers     = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] service_user.timeout           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.auth_section            = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.auth_type               = password {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.certfile                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.collect_timing          = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.insecure                = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.keyfile                 = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.split_loggers           = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] glance.timeout                 = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.backend_availability_zone = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.chap_password = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.chap_username =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_client_cert = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_client_cert_key = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_data_namespace = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.driver_use_ssl = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.extra_capabilities = {} {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.filter_function = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.goodness_function = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iscsi_target_flags =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iscsi_write_cache = on {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iser_helper   = tgtadm {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iser_ip_address = 192.168.122.86 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iser_port     = 3260 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_host      =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_login     = admin {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_mount_options = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_password  = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_private_key =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_share_path =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.num_shell_tries = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.quobyte_volume_url = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.replication_device = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.report_discard_supported = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.reserved_percentage = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_helper = tgtadm {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_ip_address = 192.168.122.86 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_port   = 3260 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_protocol = iscsi {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.trace_flags   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.unique_fqdn_network = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.use_chap_auth = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_backend_name = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_clear  = zero {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_clear_ionice = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_clear_size = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_reports.file_event_handler = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_reports.log_dir           = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.backend_availability_zone = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.backend_host         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.chap_password        = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.chap_username        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.chiscsi_conf         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_client_cert   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_data_namespace = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.driver_use_ssl       = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.extra_capabilities   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.filter_function      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.goodness_function    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iscsi_iotype         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iser_helper          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iser_ip_address      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iser_port            = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.iser_target_prefix   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_host             = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_login            = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_mount_options    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_password         = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_private_key      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_share_path       = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_ssh_port         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.num_shell_tries      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.nvmet_port_id        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.replication_device   = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.report_discard_supported = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.reserved_percentage  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.scst_target_driver   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.storage_protocol     = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_helper        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_ip_address    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_port          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_prefix        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_protocol      = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.trace_flags          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.use_chap_auth        = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_clear         = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_clear_size    = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] QuobyteHD.volumes_dir          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl      = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_notifications.driver = [] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_notifications.retry = -1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] key_manager.fixed_key          = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.barbican_api_version  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.barbican_endpoint     = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.barbican_endpoint_type = public {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.barbican_region_name  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.cafile                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.certfile              = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.collect_timing        = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.insecure              = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.keyfile               = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.number_of_retries     = 60 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.retry_delay           = 1 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.send_service_user_token = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.split_loggers         = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.timeout               = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.verify_ssl            = True {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican.verify_ssl_path       = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.auth_section = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.auth_type = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.cafile   = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.certfile = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.collect_timing = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.insecure = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.keyfile  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.split_loggers = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] barbican_service_user.timeout  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.approle_role_id          = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.approle_secret_id        = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.kv_mountpoint            = secret {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.kv_path                  = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.kv_version               = 2 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.namespace                = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.root_token_id            = **** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.ssl_ca_crt_file          = None {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.timeout                  = 60.0 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.use_ssl                  = False {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 25 19:29:27 devstack cinder-volume[83749]: DEBUG oslo_service.backend._eventlet.service [None req-4144b141-3735-46e6-b0db-cd8264f96f5c None None] ******************************************************************************** {{(pid=83749) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 25 19:29:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83952) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 25 19:29:27 devstack cinder-volume[83952]: INFO cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 25 19:29:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:29:28 devstack quobyte-client[83964]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 19:29:28 devstack quobyte-client[83964]: Invalid parameters found, error: missing mount point.
Sep 25 19:29:28 devstack quobyte-client[83964]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 19:29:28 devstack quobyte-client[83964]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] CMD "mount.quobyte" returned: 1 in 0.319s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:29:28 devstack cinder-volume[83952]: INFO cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Mounting volume: 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 ...
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 -c /etc/quobyte/client-cinder.cfg {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:29:28 devstack quobyte-client[83972]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 25 19:29:28 devstack quobyte-client[83972]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 19:29:28 devstack quobyte-client[83972]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43' to display the log.
Sep 25 19:29:28 devstack quobyte-client[83978]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 25 19:29:28 devstack quobyte-client[83978]: mount.quobyte 3.25 (4fbbd59204)
Sep 25 19:29:28 devstack quobyte-client[83978]: Client UUID: I9cD38LZ-hKlz-7bbJ-PACg-kdfUEbYJaZ2N
Sep 25 19:29:28 devstack quobyte-client[83978]: Registry: osci01.corp.quobyte.com:7861
Sep 25 19:29:28 devstack quobyte-client[83978]: Volume: cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:29:28 devstack quobyte-client[83978]: FUSE version: 316
Sep 25 19:29:28 devstack quobyte-client[83978]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 25 19:29:28 devstack quobyte-client[83978]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 25 19:29:28 devstack quobyte-client[83978]: Setting total object cache size to 3352297472 bytes
Sep 25 19:29:28 devstack quobyte-client[83978]: Using FUSE low-level API
Sep 25 19:29:28 devstack quobyte-client[83978]: Caching of uid/gid to user/group name mappings is enabled
Sep 25 19:29:28 devstack quobyte-client[83978]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 25 19:29:28 devstack quobyte-client[83978]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 25 19:29:28 devstack quobyte-client[83978]: HTTP server started on port 55000
Sep 25 19:29:28 devstack quobyte-client[83978]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 25 19:29:28 devstack quobyte-client[83978]: Mount point /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 established
Sep 25 19:29:28 devstack quobyte-client[83978]: TimeSync is running and remote sync every 60 seconds
Sep 25 19:29:28 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:28 devstack quobyte-client[83978]: Ignored time synchronization message because time source took too long to respond (56 ms)
Sep 25 19:29:28 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:28 devstack quobyte-client[83978]: Opening volume cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 (fbe9f9d9-f281-4896-b740-dea897615145)
Sep 25 19:29:28 devstack quobyte-client[83978]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 25 19:29:28 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:28 devstack quobyte-client[83978]: Changed metadata cache configuration for volume fbe9f9d9-f281-4896-b740-dea897615145 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 25 19:29:28 devstack quobyte-client[83978]: Failed to invalidate inode: 38: Function not implemented
Sep 25 19:29:28 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:28 devstack quobyte-client[83978]: Automatic minidump upload enabled by global system configuration
Sep 25 19:29:28 devstack quobyte-client[83978]: Announcing HTTP status server address 172.24.4.1
Sep 25 19:29:28 devstack quobyte-client[83978]: Registered as service (uuid I9cD38LZ-hKlz-7bbJ-PACg-kdfUEbYJaZ2N)
Sep 25 19:29:28 devstack quobyte-client[83978]: Quobyte Client running as pid 83978
Sep 25 19:29:28 devstack quobyte-client[83978]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.717s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:29:28 devstack quobyte-client[83978]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 25 19:29:28 devstack cinder-volume[83952]: INFO cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Mounting volume: 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 succeeded
Sep 25 19:29:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.773s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:29:29 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.080s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:29:29 devstack cinder-volume[83952]: INFO cinder.volume.driver [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.volume.driver [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83952) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_db.sqlalchemy.engines [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83952) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writer thread running {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.db.sqlalchemy.api [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Building query based on filter {{(pid=83952) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83952) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 25 19:29:29 devstack cinder-volume[83952]: INFO cinder.keymgr.migration [None req-3a431837-9714-4e65-a2bd-b6fc919e109e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.086s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:29:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Driver initialization completed successfully.
Sep 25 19:29:29 devstack cinder-volume[83952]: INFO cinder.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Initiating service 3 cleanup
Sep 25 19:29:29 devstack cinder-volume[83952]: INFO cinder.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Service 3 cleanup completed.
Sep 25 19:29:29 devstack cinder-volume[83952]: DEBUG cinder.service [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Creating RPC server for service cinder-volume {{(pid=83952) start /opt/stack/cinder/cinder/service.py:239}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG cinder.service [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83952) start /opt/stack/cinder/cinder/service.py:245}}
Sep 25 19:29:30 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 25 19:29:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:29:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:29:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.137s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:29:30 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d03e147-ab32-42b8-add0-f37ebb3818d1 None None] Driver post RPC initialization completed successfully.
Sep 25 19:29:31 devstack quobyte-client[83978]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 25 19:29:37 devstack cinder-volume[83749]: DEBUG dbcounter [-] [83749] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83749) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:29:40 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:29:40 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:30:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Flow 'volume_create_manager' (85945f7c-598c-479e-8d15-8f98116de011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f8c141-3232-4a95-9932-8761e9857649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f8c141-3232-4a95-9932-8761e9857649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-441524431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe62561-3cfa-4d34-bc45-76d6f7d6c02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edc18a6b7854ab691c5b47f7e0efbea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:30:47Z,use_quota=True,user_id='c29d8c6c5a66421b899646701a7bcc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a1fdf-a08a-41ea-b3bc-59a83fbb25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a1fdf-a08a-41ea-b3bc-59a83fbb25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2663f89c-7e45-4a84-a882-7862058c8e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2663f89c-7e45-4a84-a882-7862058c8e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe62561-3cfa-4d34-bc45-76d6f7d6c02f', 'volume_name': 'volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2ff03b-c9ef-421d-95c3-d33e169fa852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2ff03b-c9ef-421d-95c3-d33e169fa852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e756f52f-e33c-4cbf-846e-4c561798a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume ebe62561-3cfa-4d34-bc45-76d6f7d6c02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f', 'volume_size': 1}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-441524431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe62561-3cfa-4d34-bc45-76d6f7d6c02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2edc18a6b7854ab691c5b47f7e0efbea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:30:47Z,use_quota=True,user_id='c29d8c6c5a66421b899646701a7bcc9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Creating volume ebe62561-3cfa-4d34-bc45-76d6f7d6c02f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:30:47 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:30:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:30:47 devstack quobyte-client[83978]: System call of process 84257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:30:48 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=2, name=volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:30:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f 1073741824" returned: 0 in 0.988s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:30:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:30:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" returned: 0 in 0.192s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:30:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] <== create_volume: return (1273ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:30:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:30:49 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e756f52f-e33c-4cbf-846e-4c561798a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:49 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22833f-525e-454b-b7be-c4c7f4631c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:30:49 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f (ebe62561-3cfa-4d34-bc45-76d6f7d6c02f): created successfully
Sep 25 19:30:49 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22833f-525e-454b-b7be-c4c7f4631c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:30:49 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Flow 'volume_create_manager' (85945f7c-598c-479e-8d15-8f98116de011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:30:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4e235622-39a6-454d-81ed-271250bcbdd6 tempest-VolumesAssistedSnapshotsTest-1563275085 None] Created volume successfully.
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:30:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.288s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:30:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:30:59 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:30:59 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:31:40 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:31:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:31:46 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:31:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Flow 'volume_create_manager' (e0e1efd9-f52b-4efe-942a-61e8c7842181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:31:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f289c3e-946a-439a-88dc-6b7c6c6f6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f289c3e-946a-439a-88dc-6b7c6c6f6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1666729933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcde7d86-9079-4c39-8b8e-9bd71c6f0265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971068e880014459a5ea8241d2daf640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:31:46Z,use_quota=True,user_id='fd47fec684594969a2087885605edc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace8342-2a8b-460e-bd49-27f144dbd92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace8342-2a8b-460e-bd49-27f144dbd92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fcbf12-cf7b-431a-bf03-10ecb0127a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fcbf12-cf7b-431a-bf03-10ecb0127a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcde7d86-9079-4c39-8b8e-9bd71c6f0265', 'volume_name': 'volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccfd63f-c4ab-449d-99b8-c61e13f492ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccfd63f-c4ab-449d-99b8-c61e13f492ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f60247e-86b6-494b-9e9e-25b7fe238b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:48 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Volume bcde7d86-9079-4c39-8b8e-9bd71c6f0265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265', 'volume_size': 1}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1666729933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcde7d86-9079-4c39-8b8e-9bd71c6f0265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971068e880014459a5ea8241d2daf640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:31:46Z,use_quota=True,user_id='fd47fec684594969a2087885605edc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Creating volume bcde7d86-9079-4c39-8b8e-9bd71c6f0265 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:31:48 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:31:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:31:48 devstack quobyte-client[83978]: System call of process 84959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:31:48 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=3, name=volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:31:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 1073741824" returned: 0 in 1.027s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:31:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:31:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" returned: 0 in 0.488s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:31:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] <== create_volume: return (1928ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:31:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:31:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f60247e-86b6-494b-9e9e-25b7fe238b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf6f6b-ec26-493f-8a5a-6dbd166e95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:31:51 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Volume volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 (bcde7d86-9079-4c39-8b8e-9bd71c6f0265): created successfully
Sep 25 19:31:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf6f6b-ec26-493f-8a5a-6dbd166e95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:31:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Flow 'volume_create_manager' (e0e1efd9-f52b-4efe-942a-61e8c7842181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:31:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ee77a1ab-6e7b-4099-9fbd-255fdf458efd tempest-VolumesAdminNegativeTest-716687769 None] Created volume successfully.
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:31:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:31:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Acquiring lock "cinder-bcde7d86-9079-4c39-8b8e-9bd71c6f0265-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:31:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "cinder-bcde7d86-9079-4c39-8b8e-9bd71c6f0265-delete_volume" acquired by "delete_volume" :: waited 0.399s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:31:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 1.248s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:31:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:31:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:31:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Acquiring lock "cinder-quobyte-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:31:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "cinder-quobyte-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" acquired by "delete_volume" :: waited 0.036s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:31:55 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppn9uzj28/privsep.sock']
Sep 25 19:31:56 devstack sudo[84989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppn9uzj28/privsep.sock
Sep 25 19:31:56 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:32:04 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:32:05 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:32:10 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root
Sep 25 19:32:10 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Spawned new privsep daemon via rootwrap
Sep 25 19:32:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Accepted privsep connection to /tmp/tmppn9uzj28/privsep.sock {{(pid=83952) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 25 19:32:10 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 25 19:32:10 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 25 19:32:10 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 25 19:32:10 devstack cinder-volume[83952]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85073
Sep 25 19:32:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4dfa65-8ff5-49cd-86bf-18a1278fcba3]: (2,) {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:32:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6646ff-e0bb-4301-a68b-ec4afe5ba0d1]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:32:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:10 devstack quobyte-client[83978]: System call of process 85097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:10 devstack quobyte-client[83978]: System call of process 85097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" returned: 0 in 0.727s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" returned: 0 in 0.140s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "cinder-quobyte-bcde7d86-9079-4c39-8b8e-9bd71c6f0265" released by "delete_volume" :: held 15.593s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:32:11 devstack cinder-volume[83952]: WARNING cinder.quota [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:32:11 devstack cinder-volume[83952]: WARNING cinder.quota [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:32:11 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Created reservations ['3d997927-883b-4f46-87e5-780252299905', '78169f16-994b-4977-a428-577b188113bb', 'cb97ddbf-b096-4961-be15-6aafaaa74e9e', 'b09d632b-5ffd-459e-96e0-387ac90d1273'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.131s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:32:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Deleted volume successfully.
Sep 25 19:32:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ec62500-b23d-42bb-aaac-6649944903ab tempest-VolumesAdminNegativeTest-716687769 None] Lock "cinder-bcde7d86-9079-4c39-8b8e-9bd71c6f0265-delete_volume" released by "delete_volume" :: held 18.011s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:32:22 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:32:22 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:32:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:32:50 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (2e38b1c8-3c42-4d72-b52d-68a67a466da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e7ca27-c752-4d49-b20f-4e2a5d1313ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e7ca27-c752-4d49-b20f-4e2a5d1313ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1317616320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d20195-7e5b-48f4-9ad9-d75eaf07ad1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:51Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bac4f9a-8b8a-4178-a43a-de14afaf4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bac4f9a-8b8a-4178-a43a-de14afaf4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3a82d5-27cc-46a3-89ee-28b375eb3180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3a82d5-27cc-46a3-89ee-28b375eb3180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d20195-7e5b-48f4-9ad9-d75eaf07ad1f', 'volume_name': 'volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c43e49-8842-420f-8b4f-effa45343f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c43e49-8842-420f-8b4f-effa45343f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8756da-5115-41f9-b1b8-a96eeaf07575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:51 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Volume 05d20195-7e5b-48f4-9ad9-d75eaf07ad1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f', 'volume_size': 1}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1317616320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d20195-7e5b-48f4-9ad9-d75eaf07ad1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:51Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Creating volume 05d20195-7e5b-48f4-9ad9-d75eaf07ad1f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:32:51 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:51 devstack quobyte-client[83978]: System call of process 85280 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:51 devstack quobyte-client[83978]: System call of process 85280 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:51 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=4, name=volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f 1073741824" returned: 0 in 0.425s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" returned: 0 in 0.196s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:32:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8756da-5115-41f9-b1b8-a96eeaf07575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432c4e67-42eb-4608-8a51-c67449c45267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:52 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Volume volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f (05d20195-7e5b-48f4-9ad9-d75eaf07ad1f): created successfully
Sep 25 19:32:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432c4e67-42eb-4608-8a51-c67449c45267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (2e38b1c8-3c42-4d72-b52d-68a67a466da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:52 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ca9f9386-06b6-4b6c-9251-eec4129da556 tempest-VolumesTestJSON-1877807478 None] Created volume successfully.
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.365s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:32:54 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (95c7ab4f-afe8-4e78-9c4d-e959f25aaf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e315d8-368c-46a0-b122-c1560f14811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e315d8-368c-46a0-b122-c1560f14811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533067041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4685776c-73e0-4ad2-b573-804e68ccbaa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:54Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e809ea-b3c0-4bb3-b5e9-775015b99bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e809ea-b3c0-4bb3-b5e9-775015b99bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab233b22-7cd7-4676-bd54-13a15fcc24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab233b22-7cd7-4676-bd54-13a15fcc24e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4685776c-73e0-4ad2-b573-804e68ccbaa6', 'volume_name': 'volume-4685776c-73e0-4ad2-b573-804e68ccbaa6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af67eac3-d9d4-47b7-866c-3547cae4bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af67eac3-d9d4-47b7-866c-3547cae4bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af45e26-fbc0-4c8d-a28f-59ebc8018134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:54 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Volume 4685776c-73e0-4ad2-b573-804e68ccbaa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4685776c-73e0-4ad2-b573-804e68ccbaa6', 'volume_size': 1}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533067041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4685776c-73e0-4ad2-b573-804e68ccbaa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:54Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Creating volume 4685776c-73e0-4ad2-b573-804e68ccbaa6 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:32:54 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:54 devstack quobyte-client[83978]: System call of process 85294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:54 devstack quobyte-client[83978]: System call of process 85294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:54 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=5, name=volume-4685776c-73e0-4ad2-b573-804e68ccbaa6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 1073741824" returned: 0 in 0.385s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:32:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.603s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af45e26-fbc0-4c8d-a28f-59ebc8018134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4685776c-73e0-4ad2-b573-804e68ccbaa6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13812107-3987-435c-90ee-499e747b4509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Volume volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 (4685776c-73e0-4ad2-b573-804e68ccbaa6): created successfully
Sep 25 19:32:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13812107-3987-435c-90ee-499e747b4509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (95c7ab4f-afe8-4e78-9c4d-e959f25aaf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b4ad39d7-b674-4634-a412-d05da09c12de tempest-VolumesTestJSON-1877807478 None] Created volume successfully.
Sep 25 19:32:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (058f03c9-10c6-4561-9e32-0a6689c41f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e335a096-4f83-436c-95d3-7593e63394a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e335a096-4f83-436c-95d3-7593e63394a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854336206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2ec97f-fe19-4c3c-853a-fcca51ca7471,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:57Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef06173-3ea9-4f26-8f94-90f431ee3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef06173-3ea9-4f26-8f94-90f431ee3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106381a6-49ed-408e-bceb-5372f4a47d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106381a6-49ed-408e-bceb-5372f4a47d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2ec97f-fe19-4c3c-853a-fcca51ca7471', 'volume_name': 'volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8f1e9f-33d0-4861-9643-be01ee53dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8f1e9f-33d0-4861-9643-be01ee53dd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901eb37-c942-478f-93e6-17550d627b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:56 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Volume 6a2ec97f-fe19-4c3c-853a-fcca51ca7471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471', 'volume_size': 1}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-854336206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2ec97f-fe19-4c3c-853a-fcca51ca7471,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed31dfee3fef4d89bf7715668fc3a218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:57Z,use_quota=True,user_id='2f368fcdae4f4316910ca319e0dc05f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Creating volume 6a2ec97f-fe19-4c3c-853a-fcca51ca7471 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:32:56 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:32:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:57 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=6, name=volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 1073741824" returned: 0 in 0.383s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901eb37-c942-478f-93e6-17550d627b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ecfc39-3db2-4a27-8f6d-9fce14bc220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:57 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Volume volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 (6a2ec97f-fe19-4c3c-853a-fcca51ca7471): created successfully
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ecfc39-3db2-4a27-8f6d-9fce14bc220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Flow 'volume_create_manager' (058f03c9-10c6-4561-9e32-0a6689c41f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-26c8a8fd-a8ea-470a-91dc-350db8591a77 tempest-VolumesTestJSON-1877807478 None] Created volume successfully.
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-6a2ec97f-fe19-4c3c-853a-fcca51ca7471-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "cinder-6a2ec97f-fe19-4c3c-853a-fcca51ca7471-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:32:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-quobyte-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:32:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Flow 'volume_create_manager' (928dca3d-a8f1-4ce4-8229-d45e27c1ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438c4338-3aff-410e-9342-9844f777fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438c4338-3aff-410e-9342-9844f777fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1763842229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0da6a71-522d-4dd7-98fd-a7f68f6df666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac0b894174f44a2106d8569011dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:59Z,use_quota=True,user_id='e1d14cd87c0e4a51806a9bbe02cd6f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c5ef73-7ca8-4418-947a-60f5a9eaa246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c5ef73-7ca8-4418-947a-60f5a9eaa246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d6b2b-9e9a-416e-a05b-88b4d0c55e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d6b2b-9e9a-416e-a05b-88b4d0c55e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0da6a71-522d-4dd7-98fd-a7f68f6df666', 'volume_name': 'volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4992c8c3-6ef7-48aa-b23d-024af3e85ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4992c8c3-6ef7-48aa-b23d-024af3e85ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354f9de3-0481-4d58-8dc6-721d68be5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:32:59 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume a0da6a71-522d-4dd7-98fd-a7f68f6df666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666', 'volume_size': 1}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1763842229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0da6a71-522d-4dd7-98fd-a7f68f6df666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890ac0b894174f44a2106d8569011dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:32:59Z,use_quota=True,user_id='e1d14cd87c0e4a51806a9bbe02cd6f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Creating volume a0da6a71-522d-4dd7-98fd-a7f68f6df666 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:32:59 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:32:59 devstack quobyte-client[83978]: System call of process 85314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:32:59 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=7, name=volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" acquired by "delete_volume" :: waited 0.367s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa4096-2764-48a9-b478-0007260e883e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:32:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 1073741824" returned: 0 in 0.549s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666" returned: 0 in 0.296s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354f9de3-0481-4d58-8dc6-721d68be5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:00 devstack quobyte-client[83978]: System call of process 85317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:00 devstack quobyte-client[83978]: System call of process 85317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f418a-9cfe-4d35-b299-456a70818e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:00 devstack quobyte-client[83978]: System call of process 85317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:00 devstack quobyte-client[83978]: System call of process 85317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:00 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 (a0da6a71-522d-4dd7-98fd-a7f68f6df666): created successfully
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f418a-9cfe-4d35-b299-456a70818e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Flow 'volume_create_manager' (928dca3d-a8f1-4ce4-8229-d45e27c1ace0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:33:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-12efcee1-4834-4649-8f06-3db60a043f5b tempest-AttachSCSIVolumeTestJSON-1681201649 None] Created volume successfully.
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" returned: 0 in 0.931s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" returned: 0 in 0.165s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-6a2ec97f-fe19-4c3c-853a-fcca51ca7471" released by "delete_volume" :: held 1.331s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Created reservations ['f7b78b20-d5a2-4346-b35e-250ee25d88ec', '73f4da79-4451-42e3-85fd-8c825c8b6d65', '9653cbfe-fcf7-46e6-8760-6fad23290481', '08bc46e1-b848-49bf-b02c-228f9d61a302'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-4685776c-73e0-4ad2-b573-804e68ccbaa6-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.526s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Deleted volume successfully.
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "cinder-4685776c-73e0-4ad2-b573-804e68ccbaa6-delete_volume" acquired by "delete_volume" :: waited 0.332s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a07bf5b4-ae39-4d42-8f8d-efc49e6cee5a tempest-VolumesTestJSON-1877807478 None] Lock "cinder-6a2ec97f-fe19-4c3c-853a-fcca51ca7471-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-quobyte-4685776c-73e0-4ad2-b573-804e68ccbaa6" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-4685776c-73e0-4ad2-b573-804e68ccbaa6" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[16729f2c-6094-4999-87ff-e556c6eda87c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:03 devstack quobyte-client[83978]: System call of process 85333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:03 devstack quobyte-client[83978]: System call of process 85333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:03 devstack quobyte-client[83978]: System call of process 85333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6" returned: 0 in 1.194s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4685776c-73e0-4ad2-b573-804e68ccbaa6" returned: 0 in 0.202s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-4685776c-73e0-4ad2-b573-804e68ccbaa6" released by "delete_volume" :: held 1.880s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:04 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Created reservations ['4c049f7a-55e6-4002-af28-b363f67cef7e', '6f985f7b-135d-4618-87e0-fac247613f35', 'c978df1e-e26e-4c2a-aaf2-2deaf6314038', '822051f3-c344-4f65-ac8a-7c28c5cd4e75'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.143s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:05 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Deleted volume successfully.
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3c79f874-a0d2-4ab3-8fcb-2aa7e99bc1fa tempest-VolumesTestJSON-1877807478 None] Lock "cinder-4685776c-73e0-4ad2-b573-804e68ccbaa6-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "cinder-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f-delete_volume" acquired by "delete_volume" :: waited 0.253s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Acquiring lock "cinder-quobyte-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" acquired by "delete_volume" :: waited 0.042s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed3924-ebf5-4ee5-add9-603872974847]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:07 devstack quobyte-client[83978]: System call of process 85382 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:07 devstack quobyte-client[83978]: System call of process 85382 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:07 devstack quobyte-client[83978]: System call of process 85382 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" returned: 0 in 0.955s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" returned: 0 in 0.240s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "cinder-quobyte-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f" released by "delete_volume" :: held 1.561s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Created reservations ['4fe5505c-c1b5-4036-99d9-3518ef1fc638', '63fdda7a-bb1d-4601-b363-0342763605f2', 'bd0d336d-633d-427c-a76f-62da67df9a95', 'cb5b752b-4389-43ad-93cd-3592a9f5a244'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.227s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:09 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Deleted volume successfully.
Sep 25 19:33:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1631328c-2fe7-4a1e-a6fc-be309e0deceb tempest-VolumesTestJSON-1877807478 None] Lock "cinder-05d20195-7e5b-48f4-9ad9-d75eaf07ad1f-delete_volume" released by "delete_volume" :: held 3.950s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab40fd-9881-48ba-bb41-208b049dd4c9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" returned: 0 in 0.480s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.534s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.745s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e709c2a7-91b0-4b10-ac1b-a0c0359e045c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '128b9532-abbd-4eff-82c6-1e5b428084a8', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:33:17 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:17 devstack quobyte-client[83978]: System call of process 85413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:17 devstack quobyte-client[83978]: System call of process 85413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:17 devstack quobyte-client[83978]: System call of process 85413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:17 devstack quobyte-client[83978]: System call of process 85413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666" returned: 0 in 0.620s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.657s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-ea3ca8ea-90ee-4c0c-949f-c966cc930501 req-da9a9787-28a1-425a-9f1f-61a5f17a409f tempest-VolumesAssistedSnapshotsTest-1563275085 None] attachment_update completed successfully.
Sep 25 19:33:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cce9b5e-9d88-4ca3-928c-b08b5dd4dbce', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:33:17 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-6a7c53e7-6ae9-483a-9204-e21a5b337e76 req-4535b29f-f2d9-4088-816b-af61ed29a9c2 tempest-AttachSCSIVolumeTestJSON-1681201649 None] attachment_update completed successfully.
Sep 25 19:33:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-88849d5d-a8c6-44c2-9b88-1af298c248cf tempest-GroupsV320Test-1128577279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-88849d5d-a8c6-44c2-9b88-1af298c248cf tempest-GroupsV320Test-1128577279 None] Group tempest-GroupsV320Test-Group-1092414242: creating
Sep 25 19:33:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-88849d5d-a8c6-44c2-9b88-1af298c248cf tempest-GroupsV320Test-1128577279 None] Group tempest-GroupsV320Test-Group-1092414242: created successfully
Sep 25 19:33:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-88849d5d-a8c6-44c2-9b88-1af298c248cf tempest-GroupsV320Test-1128577279 None] Create group completed successfully.
Sep 25 19:33:21 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Created reservations ['fa14bc03-d44a-402e-b8c0-84d287931337'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.127s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:22 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-021ead03-25b2-4dfa-b0bb-f0eb3766cc66 tempest-GroupsV320Test-1128577279 None] Delete group completed successfully.
Sep 25 19:33:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:29 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Flow 'volume_create_manager' (b6794355-c753-46e2-b999-6d4f9c9b90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb37188-00e2-4c5e-91b8-de6829a49a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb37188-00e2-4c5e-91b8-de6829a49a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2079768934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c697f98-2126-4d63-ba7c-1f2ab14656af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c318321370b4dfaa0a9a308768aa2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:33:30Z,use_quota=True,user_id='6d9ed5dfa3c44d279c00d1d50fc7dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053e5c53-9ec1-4611-9c12-89cde07ef665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053e5c53-9ec1-4611-9c12-89cde07ef665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5c53a0-ac13-48f3-ba52-2e18ee0a0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5c53a0-ac13-48f3-ba52-2e18ee0a0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c697f98-2126-4d63-ba7c-1f2ab14656af', 'volume_name': 'volume-9c697f98-2126-4d63-ba7c-1f2ab14656af', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31656cb-6786-4f21-b286-0212139bf54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31656cb-6786-4f21-b286-0212139bf54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ac5d41-7ccd-465a-98cb-a9c4472c791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Volume 9c697f98-2126-4d63-ba7c-1f2ab14656af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c697f98-2126-4d63-ba7c-1f2ab14656af', 'volume_size': 1}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2079768934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c697f98-2126-4d63-ba7c-1f2ab14656af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c318321370b4dfaa0a9a308768aa2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:33:30Z,use_quota=True,user_id='6d9ed5dfa3c44d279c00d1d50fc7dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Creating volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:33:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:30 devstack quobyte-client[83978]: System call of process 85835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:30 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=8, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af 1073741824" returned: 0 in 0.340s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af" returned: 0 in 0.074s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.483s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ac5d41-7ccd-465a-98cb-a9c4472c791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c697f98-2126-4d63-ba7c-1f2ab14656af', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2a3376-c820-47da-a96c-51d9e8ddebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:33:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Volume volume-9c697f98-2126-4d63-ba7c-1f2ab14656af (9c697f98-2126-4d63-ba7c-1f2ab14656af): created successfully
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2a3376-c820-47da-a96c-51d9e8ddebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:33:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Flow 'volume_create_manager' (b6794355-c753-46e2-b999-6d4f9c9b90e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:33:30 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-781f548a-0cff-4c4e-b472-58c966ecbdc2 tempest-SnapshotsActionsTest-1016877366 None] Created volume successfully.
Sep 25 19:33:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Creating offline snapshot e4d3f96d-14cf-49f4-89fe-f221cd7e083d of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[243127a0-62a7-4b5b-8b83-720ce0214877]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af" returned: 0 in 0.409s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=9, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d 1G" returned: 0 in 0.230s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.113s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.073s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.info" returned: 0 in 0.082s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.info" returned: 0 in 0.070s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.376s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5d5b6709-b23d-406a-ad92-7a160ac29088 tempest-SnapshotsActionsTest-1016877366 None] Create snapshot completed successfully
Sep 25 19:33:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Creating offline snapshot 4bd6c5f2-5b12-4d04-9f18-7f97db72842f of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07f078-a866-4f58-8efc-96c6ed0730cf]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.376s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:35 devstack quobyte-client[83978]: System call of process 85870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:35 devstack quobyte-client[83978]: System call of process 85870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=11, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f 1G" returned: 0 in 0.372s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:36 devstack quobyte-client[83978]: System call of process 85873 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.139s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.340s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-867d56cd-961b-4d9c-8dfb-dc4d831c1be1 tempest-SnapshotsActionsTest-1016877366 None] Create snapshot completed successfully
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-4bd6c5f2-5b12-4d04-9f18-7f97db72842f-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-4bd6c5f2-5b12-4d04-9f18-7f97db72842f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-4bd6c5f2-5b12-4d04-9f18-7f97db72842f" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-4bd6c5f2-5b12-4d04-9f18-7f97db72842f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Deleting offline snapshot 4bd6c5f2-5b12-4d04-9f18-7f97db72842f of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] snapshot_file for this snap is: volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[11992463-438d-4507-bcbe-f5acd99443ad]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:37 devstack quobyte-client[83978]: System call of process 85878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:37 devstack quobyte-client[83978]: System call of process 85878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.391s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c49738-3dc7-471a-9b2b-6b083c0726c8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:38 devstack quobyte-client[83978]: System call of process 85881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.359s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:38 devstack quobyte-client[83978]: System call of process 85884 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.275s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.4bd6c5f2-5b12-4d04-9f18-7f97db72842f" returned: 0 in 0.076s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-4bd6c5f2-5b12-4d04-9f18-7f97db72842f" released by "_delete_snapshot" :: held 1.393s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_snapshot" :: held 1.419s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:38 devstack cinder-volume[83952]: WARNING cinder.quota [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Created reservations ['753b2cbe-0803-4f7b-839e-1d441727f24b', 'fa897719-ef3c-42d8-bffc-08aec4a77b5a', '62e1070f-9057-4ecf-86e1-985cc86179b6', '854b3882-b6e1-423d-8fe9-1387a636309a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Delete snapshot completed successfully.
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0d5324a1-7c2b-491f-817d-33fd59817d9f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-4bd6c5f2-5b12-4d04-9f18-7f97db72842f-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:39 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Creating offline snapshot eac2f853-13af-4b34-8c4d-5e89573ae52b of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e79e00-dc21-4af9-8542-7ad5740fd182]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.398s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:40 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=12, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b 1G" returned: 0 in 0.283s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.132s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.074s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:33:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.244s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a67781ed-d3cb-49e4-b652-d92bec82ce7f tempest-SnapshotsActionsTest-1016877366 None] Create snapshot completed successfully
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-eac2f853-13af-4b34-8c4d-5e89573ae52b-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-eac2f853-13af-4b34-8c4d-5e89573ae52b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-eac2f853-13af-4b34-8c4d-5e89573ae52b" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-eac2f853-13af-4b34-8c4d-5e89573ae52b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Deleting offline snapshot eac2f853-13af-4b34-8c4d-5e89573ae52b of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] snapshot_file for this snap is: volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a062c8b-08c6-4e2e-8d28-55da81c55b2b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:42 devstack quobyte-client[83978]: System call of process 85924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.387s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac1aea-7482-4366-913e-8c308902ff9c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.367s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:43 devstack quobyte-client[83978]: System call of process 85936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:43 devstack quobyte-client[83978]: System call of process 85936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.273s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.eac2f853-13af-4b34-8c4d-5e89573ae52b" returned: 0 in 0.079s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-eac2f853-13af-4b34-8c4d-5e89573ae52b" released by "_delete_snapshot" :: held 1.378s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_snapshot" :: held 1.402s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=46,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=50,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=6 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Created reservations ['421dbf25-7796-4d68-bc20-92a67985e960', '74a780ac-f5df-488f-94d0-41cb421775f3', '8f4b151e-530e-445c-9183-27879ee52e69', 'c6026106-866f-46da-ab0f-d315363f4aad'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:43 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Delete snapshot completed successfully.
Sep 25 19:33:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0653501f-b62d-410b-8e3b-bb8e4c59946f tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-eac2f853-13af-4b34-8c4d-5e89573ae52b-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Creating offline snapshot 8ddcca61-a345-48f8-aec5-d3c0ef909a46 of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:33:44 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873c552-0784-48e5-bc95-f432e0bd8b6e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.387s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:45 devstack quobyte-client[83978]: System call of process 85943 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:45 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=13, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 1G" returned: 0 in 0.265s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:45 devstack quobyte-client[83978]: System call of process 85946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:45 devstack quobyte-client[83978]: System call of process 85946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:45 devstack quobyte-client[83978]: System call of process 85946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.127s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.075s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.088s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.185s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-291c3c37-4a6a-42b9-900c-5c6cd0cf4e42 tempest-SnapshotsActionsTest-1016877366 None] Create snapshot completed successfully
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-8ddcca61-a345-48f8-aec5-d3c0ef909a46-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-8ddcca61-a345-48f8-aec5-d3c0ef909a46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-8ddcca61-a345-48f8-aec5-d3c0ef909a46" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-8ddcca61-a345-48f8-aec5-d3c0ef909a46" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Deleting offline snapshot 8ddcca61-a345-48f8-aec5-d3c0ef909a46 of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] snapshot_file for this snap is: volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba453a5-af4a-4773-80e8-d80de5438091]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.405s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd2c47-0765-4b8b-acbc-781ff3d596e6]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.375s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:47 devstack quobyte-client[83978]: System call of process 85959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:47 devstack quobyte-client[83978]: System call of process 85959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:47 devstack quobyte-client[83978]: System call of process 85959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-5c84189a-de18-4c56-9fe9-c9051ac5f912 req-290b3522-2a1a-4cbb-9596-2884948c783e tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.749s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-5c84189a-de18-4c56-9fe9-c9051ac5f912 req-290b3522-2a1a-4cbb-9596-2884948c783e tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-5c84189a-de18-4c56-9fe9-c9051ac5f912 req-290b3522-2a1a-4cbb-9596-2884948c783e tempest-AttachSCSIVolumeTestJSON-1681201649 None] Terminate volume connection completed successfully.
Sep 25 19:33:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-5c84189a-de18-4c56-9fe9-c9051ac5f912 req-290b3522-2a1a-4cbb-9596-2884948c783e tempest-AttachSCSIVolumeTestJSON-1681201649 None] Deleting attachment 0cce9b5e-9d88-4ca3-928c-b08b5dd4dbce. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:33:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-58eed2e8-f0f6-4661-9226-ee36ef10af59 req-0d3889c9-ab56-4548-879e-9510ef60a4fb tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.8ddcca61-a345-48f8-aec5-d3c0ef909a46" returned: 0 in 0.320s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-8ddcca61-a345-48f8-aec5-d3c0ef909a46" released by "_delete_snapshot" :: held 2.088s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_snapshot" :: held 2.145s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-58eed2e8-f0f6-4661-9226-ee36ef10af59 req-0d3889c9-ab56-4548-879e-9510ef60a4fb tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-58eed2e8-f0f6-4661-9226-ee36ef10af59 req-0d3889c9-ab56-4548-879e-9510ef60a4fb tempest-VolumesAssistedSnapshotsTest-1563275085 None] Terminate volume connection completed successfully.
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-58eed2e8-f0f6-4661-9226-ee36ef10af59 req-0d3889c9-ab56-4548-879e-9510ef60a4fb tempest-VolumesAssistedSnapshotsTest-1563275085 None] Deleting attachment 128b9532-abbd-4eff-82c6-1e5b428084a8. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Created reservations ['cf912245-6989-4bc3-98f2-c4e76fe260a6', 'd8bc9639-1293-40c6-9bca-256895beaa6c', '1b79536c-b069-4d41-942f-f27277eb21e1', '2950cca8-e9c2-4468-9df4-915d53812f8e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Delete snapshot completed successfully.
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d1e2d7d8-2c92-4d68-80bb-097ca50772dd tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-8ddcca61-a345-48f8-aec5-d3c0ef909a46-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Creating offline snapshot d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[da39fa1a-05cc-45b4-afd3-7af19bc05aa4]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.395s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=14, name=volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 1G" returned: 0 in 0.336s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack quobyte-client[83978]: System call of process 85971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img rebase -u -b volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.186s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:33:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "cinder-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.334s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.191s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "cinder-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f-delete_volume" acquired by "delete_volume" :: waited 0.457s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5c5737e8-ceac-48a7-b50e-8847f735928a tempest-SnapshotsActionsTest-1016877366 None] Create snapshot completed successfully
Sep 25 19:33:51 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "cinder-quobyte-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "cinder-quobyte-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" acquired by "delete_volume" :: waited 0.037s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5cce0-2d07-46ed-90b3-6d7853e98389]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.253s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:52 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:52 devstack quobyte-client[83978]: System call of process 85976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_snapshot" :: waited 0.125s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Acquiring lock "cinder-quobyte-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" returned: 0 in 0.968s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" acquired by "_delete_snapshot" :: waited 0.629s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Deleting offline snapshot d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] snapshot_file for this snap is: volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" returned: 0 in 0.745s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6565c39-5206-4969-9c0e-a413e036f6d0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "cinder-quobyte-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f" released by "delete_volume" :: held 1.913s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:54 devstack quobyte-client[83978]: System call of process 86019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:54 devstack quobyte-client[83978]: System call of process 86019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.425s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.898s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Created reservations ['c90a759e-8fb1-4b1f-9e96-440c9f27a889', 'd0717e03-26a8-40d5-8e45-63cb42133f34', '22391eb7-677f-4e58-ad79-7108d36fd955', 'adae5d7e-7480-45bf-9d18-aa2d194a0163'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a387b2-951b-4f6d-8296-20dcc16e21d9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:33:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.158s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:33:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Deleted volume successfully.
Sep 25 19:33:55 devstack quobyte-client[83978]: System call of process 86023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 1.146s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:33:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:56 devstack quobyte-client[83978]: System call of process 86028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:56 devstack quobyte-client[83978]: System call of process 86028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:56 devstack quobyte-client[83978]: System call of process 86028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d8c96dea-90cd-415c-ac9b-5ca19e1e3e2c tempest-VolumesAssistedSnapshotsTest-1563275085 None] Lock "cinder-ebe62561-3cfa-4d34-bc45-76d6f7d6c02f-delete_volume" released by "delete_volume" :: held 4.586s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.622s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" returned: 0 in 0.208s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7" released by "_delete_snapshot" :: held 3.476s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_snapshot" :: held 4.151s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:33:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Created reservations ['f4676a20-369d-4beb-8754-c066ab0957fa', '5955326d-efdc-418c-ba86-938e8ced6393', 'c03f2d2d-c2fa-4eff-b438-54605162068a', '20ca180e-62b8-4813-b1fe-83d63d6346de'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:33:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Delete snapshot completed successfully.
Sep 25 19:33:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84546569-ade6-4387-ad0a-f78aac7c2be8 tempest-SnapshotsActionsTest-1734571598 None] Lock "cinder-d5c1a5a8-b4cc-4db3-af0c-734f93d53dd7-delete_snapshot" released by "delete_snapshot" :: held 5.383s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "cinder-e4d3f96d-14cf-49f4-89fe-f221cd7e083d-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-e4d3f96d-14cf-49f4-89fe-f221cd7e083d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "cinder-quobyte-e4d3f96d-14cf-49f4-89fe-f221cd7e083d" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-e4d3f96d-14cf-49f4-89fe-f221cd7e083d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Deleting offline snapshot e4d3f96d-14cf-49f4-89fe-f221cd7e083d of volume 9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] snapshot_file for this snap is: volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db906cc-b37b-4fe2-9d01-0963e26d86a8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:01 devstack quobyte-client[83978]: System call of process 86090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 1.047s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c697f98-2126-4d63-ba7c-1f2ab14656af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:34:01 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb97d4f9-eff4-46e3-9a67-50963a161c3e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:02 devstack quobyte-client[83978]: System call of process 86100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af" returned: 0 in 0.919s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:03 devstack quobyte-client[83978]: System call of process 86109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:03 devstack quobyte-client[83978]: System call of process 86109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:03 devstack quobyte-client[83978]: System call of process 86109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:03 devstack quobyte-client[83978]: System call of process 86109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.777s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af.e4d3f96d-14cf-49f4-89fe-f221cd7e083d" returned: 0 in 0.249s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-e4d3f96d-14cf-49f4-89fe-f221cd7e083d" released by "_delete_snapshot" :: held 3.761s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_snapshot" :: held 3.807s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:04 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Created reservations ['729cb893-b6a8-434f-a141-518b6aab97bb', 'd174f12c-0bf8-41a2-a24a-c3258483c498', '7ef4a03e-6c1e-40fc-92d6-edc1cdb3b4aa', 'f1b4c1d0-da1d-4204-869d-b141be45cb0c'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:34:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Delete snapshot completed successfully.
Sep 25 19:34:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e9ccc9e9-6d17-4233-8282-141f8f18d1b6 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-e4d3f96d-14cf-49f4-89fe-f221cd7e083d-delete_snapshot" released by "delete_snapshot" :: held 4.898s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "cinder-9c697f98-2126-4d63-ba7c-1f2ab14656af-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-9c697f98-2126-4d63-ba7c-1f2ab14656af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16f5eb-a55b-4f19-9983-b4f6cc45587d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af" returned: 0 in 0.403s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c697f98-2126-4d63-ba7c-1f2ab14656af" returned: 0 in 0.106s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-quobyte-9c697f98-2126-4d63-ba7c-1f2ab14656af" released by "delete_volume" :: held 0.677s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Created reservations ['0ae16fc4-328e-403e-bb52-bfbd8e12b9da', '9bbddf04-7651-4227-a5d4-b98514269922', '61982cb2-64d8-45f4-816d-c032b9a166c5', '5ff45fba-7c7a-494a-958b-e693ad537770'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.081s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:34:07 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Deleted volume successfully.
Sep 25 19:34:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f6733f1-d92b-46d7-a53f-082d9c16e9c7 tempest-SnapshotsActionsTest-1016877366 None] Lock "cinder-9c697f98-2126-4d63-ba7c-1f2ab14656af-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "cinder-a0da6a71-522d-4dd7-98fd-a7f68f6df666-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "cinder-a0da6a71-522d-4dd7-98fd-a7f68f6df666-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:12 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "cinder-quobyte-a0da6a71-522d-4dd7-98fd-a7f68f6df666" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "cinder-quobyte-a0da6a71-522d-4dd7-98fd-a7f68f6df666" acquired by "delete_volume" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ee619-cc89-4165-b9c2-146f7a2fcc5e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666" returned: 0 in 0.785s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a0da6a71-522d-4dd7-98fd-a7f68f6df666" returned: 0 in 0.166s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "cinder-quobyte-a0da6a71-522d-4dd7-98fd-a7f68f6df666" released by "delete_volume" :: held 1.191s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Created reservations ['e9e7c087-d014-486f-a8d6-dad620feb1ea', '97cf3ca4-e94e-4134-9f39-92bc7d72ae83', '29ce06a7-cbe6-47f8-acf2-eaac08b1d3f5', 'c6e8c376-241c-4a33-91ce-113b07cf42ab'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:34:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Deleted volume successfully.
Sep 25 19:34:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-89768e7b-0d46-4ddb-896a-bd5c70e1b36c tempest-AttachSCSIVolumeTestJSON-1681201649 None] Lock "cinder-a0da6a71-522d-4dd7-98fd-a7f68f6df666-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=42,cinder:INSERT=22,cinder:UPDATE=51,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:34:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=45,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:34:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Flow 'volume_create_manager' (71217df7-24b5-4f6a-bb34-831449d9c8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e7fb9f-16b5-49f3-8f5c-23e36d8e2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e7fb9f-16b5-49f3-8f5c-23e36d8e2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-882790072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d7b494-3de6-47b4-b5f1-465a9801231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4149c2e6dc32428f86567be7efa32dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:34:38Z,use_quota=True,user_id='ec9cf5952f8f4ebb9e1debe7f0241dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dca8c16-092d-4bc9-a849-bb76b938a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dca8c16-092d-4bc9-a849-bb76b938a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e034160-6237-4ad9-abbf-ea3b6d9af15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e034160-6237-4ad9-abbf-ea3b6d9af15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d7b494-3de6-47b4-b5f1-465a9801231f', 'volume_name': 'volume-40d7b494-3de6-47b4-b5f1-465a9801231f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f87dad-6db5-4321-bb9e-1bcecba5f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f87dad-6db5-4321-bb9e-1bcecba5f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba2a93-76c3-4535-81be-759e2c6b6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Volume 40d7b494-3de6-47b4-b5f1-465a9801231f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d7b494-3de6-47b4-b5f1-465a9801231f', 'volume_size': 1}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-882790072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d7b494-3de6-47b4-b5f1-465a9801231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4149c2e6dc32428f86567be7efa32dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:34:38Z,use_quota=True,user_id='ec9cf5952f8f4ebb9e1debe7f0241dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Creating volume 40d7b494-3de6-47b4-b5f1-465a9801231f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:34:38 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:38 devstack quobyte-client[83978]: System call of process 86187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=15, name=volume-40d7b494-3de6-47b4-b5f1-465a9801231f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f 1073741824" returned: 0 in 0.504s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f" returned: 0 in 0.147s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba2a93-76c3-4535-81be-759e2c6b6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d7b494-3de6-47b4-b5f1-465a9801231f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3d09f4-49f1-4ac5-a633-e47961cf2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Volume volume-40d7b494-3de6-47b4-b5f1-465a9801231f (40d7b494-3de6-47b4-b5f1-465a9801231f): created successfully
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3d09f4-49f1-4ac5-a633-e47961cf2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Flow 'volume_create_manager' (71217df7-24b5-4f6a-bb34-831449d9c8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:34:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-65979bf7-d974-4538-94cb-50b2d0833893 tempest-VolumesServicesTestJSON-1892980055 None] Created volume successfully.
Sep 25 19:34:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Acquiring lock "cinder-40d7b494-3de6-47b4-b5f1-465a9801231f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "cinder-40d7b494-3de6-47b4-b5f1-465a9801231f-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Acquiring lock "cinder-quobyte-40d7b494-3de6-47b4-b5f1-465a9801231f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "cinder-quobyte-40d7b494-3de6-47b4-b5f1-465a9801231f" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d822dcde-fd07-4935-97a3-eccdef306d44]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:41 devstack quobyte-client[83978]: System call of process 86191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f" returned: 0 in 0.520s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-40d7b494-3de6-47b4-b5f1-465a9801231f" returned: 0 in 0.110s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "cinder-quobyte-40d7b494-3de6-47b4-b5f1-465a9801231f" released by "delete_volume" :: held 0.910s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Created reservations ['eeccb64b-8c55-46fd-b0fe-f8dab8c3bbac', '98917f2a-60fa-4450-96a3-12e142f0de37', 'b692643f-ba66-4e19-bf0e-bc296564c49d', '9033dffc-0857-4332-87bb-4e265457b4ec'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:42 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:34:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Deleted volume successfully.
Sep 25 19:34:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-38812107-7429-4362-a223-60fe929bdfd4 tempest-VolumesServicesTestJSON-1892980055 None] Lock "cinder-40d7b494-3de6-47b4-b5f1-465a9801231f-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:34:52 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=7,cinder:DELETE=2,cinder:SELECT=4,cinder:INSERT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.193s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:34:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Flow 'volume_create_manager' (401e08c6-eab9-4b6f-8166-634a705b0755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5609cf5-98b3-4077-814d-251eb03af244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5609cf5-98b3-4077-814d-251eb03af244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1197941070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67a17b2-aad6-4bc4-aa38-e554ce013d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a896a21e524a8485313af4919a2189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:34:57Z,use_quota=True,user_id='c3d510928f6d4a26b856434037e090f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1983d0c2-9324-4a8e-a839-9847e631460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1983d0c2-9324-4a8e-a839-9847e631460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ee7f97-648b-4495-a1ee-96d1c19307b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ee7f97-648b-4495-a1ee-96d1c19307b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67a17b2-aad6-4bc4-aa38-e554ce013d08', 'volume_name': 'volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f399db67-6cbc-4b63-9066-87eb16d8eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f399db67-6cbc-4b63-9066-87eb16d8eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b8fe17-e8f2-4a68-8d5a-4970e8bb3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:57 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume b67a17b2-aad6-4bc4-aa38-e554ce013d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08', 'volume_size': 1}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1197941070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67a17b2-aad6-4bc4-aa38-e554ce013d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a896a21e524a8485313af4919a2189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:34:57Z,use_quota=True,user_id='c3d510928f6d4a26b856434037e090f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Creating volume b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:34:57 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:57 devstack quobyte-client[83978]: System call of process 86207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:57 devstack quobyte-client[83978]: System call of process 86207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:34:57 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=16, name=volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 1073741824" returned: 0 in 0.419s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08" returned: 0 in 0.160s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:34:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:34:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b8fe17-e8f2-4a68-8d5a-4970e8bb3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da547734-e70b-463b-873a-3f4845cd6bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:34:58 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 (b67a17b2-aad6-4bc4-aa38-e554ce013d08): created successfully
Sep 25 19:34:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da547734-e70b-463b-873a-3f4845cd6bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:34:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Flow 'volume_create_manager' (401e08c6-eab9-4b6f-8166-634a705b0755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:34:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f29fa90e-19a2-4200-bb7f-8088ddde86bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Created volume successfully.
Sep 25 19:34:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:34:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:34:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:34:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Creating offline snapshot 2c6774fd-6131-4d39-9399-e2a3f0d93b26 of volume b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:34:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[665692ff-df3b-4631-9545-802d775f3fa9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:34:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:34:59 devstack quobyte-client[83978]: System call of process 86211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08" returned: 0 in 0.566s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:00 devstack quobyte-client[83978]: System call of process 86215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:00 devstack quobyte-client[83978]: System call of process 86215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:00 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=17, name=volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 1G" returned: 0 in 0.377s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:00 devstack quobyte-client[83978]: System call of process 86218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "qemu-img rebase -u -b volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 0.228s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 0.124s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 0.205s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.info" returned: 0 in 0.180s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.info" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fd69ce6a-8e2c-4b0c-9c2a-d62fa16dd036 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Create snapshot completed successfully
Sep 25 19:35:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "cinder-2c6774fd-6131-4d39-9399-e2a3f0d93b26-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-2c6774fd-6131-4d39-9399-e2a3f0d93b26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.121s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "cinder-quobyte-2c6774fd-6131-4d39-9399-e2a3f0d93b26" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-2c6774fd-6131-4d39-9399-e2a3f0d93b26" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Deleting offline snapshot 2c6774fd-6131-4d39-9399-e2a3f0d93b26 of volume b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] snapshot_file for this snap is: volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac5170-f127-43d5-8c0c-bca19e618951]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:05 devstack quobyte-client[83978]: System call of process 86236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:05 devstack quobyte-client[83978]: System call of process 86236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:05 devstack quobyte-client[83978]: System call of process 86236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 1.494s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:35:05 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf71318-e9c7-4209-a031-cb0d1ccf18f0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:06 devstack quobyte-client[83978]: System call of process 86242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08" returned: 0 in 1.260s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 0.536s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08.2c6774fd-6131-4d39-9399-e2a3f0d93b26" returned: 0 in 0.166s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-2c6774fd-6131-4d39-9399-e2a3f0d93b26" released by "_delete_snapshot" :: held 4.111s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:35:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" released by "delete_snapshot" :: held 4.147s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:35:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Created reservations ['813a754c-5833-4859-bef2-7e9b97ad51f3', 'ed7743de-2116-4d9e-a71a-1a50f3291e9a', '9e8845d7-5ca5-4d44-8d6c-6162c6b369f8', '377a62ff-f2d7-40d2-8868-a27fbda3c5a9'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:35:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Delete snapshot completed successfully.
Sep 25 19:35:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c1f3db4-6d3e-45fe-aab0-b90535628bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-2c6774fd-6131-4d39-9399-e2a3f0d93b26-delete_snapshot" released by "delete_snapshot" :: held 4.821s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "cinder-b67a17b2-aad6-4bc4-aa38-e554ce013d08-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-b67a17b2-aad6-4bc4-aa38-e554ce013d08-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b28cc6d-4a36-417f-857d-fdf4bfc92ac5]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:10 devstack quobyte-client[83978]: System call of process 86285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:10 devstack quobyte-client[83978]: System call of process 86285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:10 devstack quobyte-client[83978]: System call of process 86285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08" returned: 0 in 0.633s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b67a17b2-aad6-4bc4-aa38-e554ce013d08" returned: 0 in 0.160s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-quobyte-b67a17b2-aad6-4bc4-aa38-e554ce013d08" released by "delete_volume" :: held 1.166s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Created reservations ['8f6aae51-8b2b-4af0-aba7-9da19ab578a5', '115f44dd-3a13-4c93-97c0-6b6a6f260dd9', '798f55bf-8a55-471e-b10d-5194107427e6', '2ac09698-6db9-4a39-b471-c9b968b414a6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.220s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:12 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:35:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Deleted volume successfully.
Sep 25 19:35:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b59cd19c-3e05-4db0-82c8-45de09452510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1440755540 None] Lock "cinder-b67a17b2-aad6-4bc4-aa38-e554ce013d08-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:35:21 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=13,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:35:22 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=12,cinder:DELETE=2,cinder:SELECT=11,cinder:INSERT=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:35:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:37 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:35:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Flow 'volume_create_manager' (fc40d164-e272-42e2-8242-657cd305422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9036bd-0d2e-4b89-9cf6-b43e5604ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9036bd-0d2e-4b89-9cf6-b43e5604ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1249137559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098fe011-91ed-4ec0-a38b-bbf89f401510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd67f7ec4c94b5daace72c4d882a007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:37Z,use_quota=True,user_id='8f74d16557854952966d938b26a4da84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83b41c1-13c0-4c36-aab4-6c4ee95bc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83b41c1-13c0-4c36-aab4-6c4ee95bc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c9e217-f1c6-4bdc-9fdf-b491bf61c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c9e217-f1c6-4bdc-9fdf-b491bf61c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098fe011-91ed-4ec0-a38b-bbf89f401510', 'volume_name': 'volume-098fe011-91ed-4ec0-a38b-bbf89f401510', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760c17db-0149-4022-a930-ba0e7cadf152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760c17db-0149-4022-a930-ba0e7cadf152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf026c4-d4f7-4874-bfa9-a0972131da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Volume 098fe011-91ed-4ec0-a38b-bbf89f401510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098fe011-91ed-4ec0-a38b-bbf89f401510', 'volume_size': 1}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1249137559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098fe011-91ed-4ec0-a38b-bbf89f401510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd67f7ec4c94b5daace72c4d882a007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:37Z,use_quota=True,user_id='8f74d16557854952966d938b26a4da84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Creating volume 098fe011-91ed-4ec0-a38b-bbf89f401510 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:35:38 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:35:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:38 devstack quobyte-client[83978]: System call of process 86501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=19, name=volume-098fe011-91ed-4ec0-a38b-bbf89f401510, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 1073741824" returned: 0 in 1.542s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510" returned: 0 in 0.264s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] <== create_volume: return (1933ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf026c4-d4f7-4874-bfa9-a0972131da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098fe011-91ed-4ec0-a38b-bbf89f401510', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddddfe0-6f6d-4a7f-a452-4443ddc85742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:40 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Volume volume-098fe011-91ed-4ec0-a38b-bbf89f401510 (098fe011-91ed-4ec0-a38b-bbf89f401510): created successfully
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddddfe0-6f6d-4a7f-a452-4443ddc85742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Flow 'volume_create_manager' (fc40d164-e272-42e2-8242-657cd305422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8d1b41fc-9a12-4bbf-9851-3af28ae91243 tempest-DeleteServersTestJSON-703666321 None] Created volume successfully.
Sep 25 19:35:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (a4f461eb-cea6-4d8e-b502-d1847c5fc980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c097f3c9-4534-4bd1-8791-9da6222d3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c097f3c9-4534-4bd1-8791-9da6222d3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1390522576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c021816d-402e-474d-8d91-fc553eb3b8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:42Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39da338c-6157-493e-b248-4f9c13b8b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39da338c-6157-493e-b248-4f9c13b8b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36a3f8a-98ac-4608-ae36-eb1b460dcd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36a3f8a-98ac-4608-ae36-eb1b460dcd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c021816d-402e-474d-8d91-fc553eb3b8ab', 'volume_name': 'volume-c021816d-402e-474d-8d91-fc553eb3b8ab', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35730c-e64f-4067-a9f6-ff1da82aa254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35730c-e64f-4067-a9f6-ff1da82aa254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f7c2f0-6d1b-4bea-aea9-d3d66fb08c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:42 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Volume c021816d-402e-474d-8d91-fc553eb3b8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c021816d-402e-474d-8d91-fc553eb3b8ab', 'volume_size': 1}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1390522576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c021816d-402e-474d-8d91-fc553eb3b8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:42Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Creating volume c021816d-402e-474d-8d91-fc553eb3b8ab {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:35:42 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:35:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:43 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=20, name=volume-c021816d-402e-474d-8d91-fc553eb3b8ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab 1073741824" returned: 0 in 0.508s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f7c2f0-6d1b-4bea-aea9-d3d66fb08c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c021816d-402e-474d-8d91-fc553eb3b8ab', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d54cc6f-6b04-4253-9d6a-94bfaff1b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:43 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Volume volume-c021816d-402e-474d-8d91-fc553eb3b8ab (c021816d-402e-474d-8d91-fc553eb3b8ab): created successfully
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d54cc6f-6b04-4253-9d6a-94bfaff1b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (a4f461eb-cea6-4d8e-b502-d1847c5fc980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:43 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fe9987d5-72eb-428f-a1e9-3b92985e58cf tempest-VolumesListAdminTestJSON-327737864 None] Created volume successfully.
Sep 25 19:35:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:46 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:35:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (75164a6c-ce7f-4687-b5ff-48b8b16b9a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fa219-f012-466a-a979-546ff1f1ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3fa219-f012-466a-a979-546ff1f1ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1317755895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afc874f-1797-4c41-a87c-d3a2a74985b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:47Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a377e-6504-4ec5-97fb-04005dd2c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377a377e-6504-4ec5-97fb-04005dd2c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd6ec33-c715-41c4-8596-fc858a85cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd6ec33-c715-41c4-8596-fc858a85cfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afc874f-1797-4c41-a87c-d3a2a74985b2', 'volume_name': 'volume-9afc874f-1797-4c41-a87c-d3a2a74985b2', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f892a-36db-44e6-8860-f5d493592557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f892a-36db-44e6-8860-f5d493592557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5388ef6-0689-415e-a279-a4a0ead58781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Volume 9afc874f-1797-4c41-a87c-d3a2a74985b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afc874f-1797-4c41-a87c-d3a2a74985b2', 'volume_size': 1}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1317755895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afc874f-1797-4c41-a87c-d3a2a74985b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:47Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Creating volume 9afc874f-1797-4c41-a87c-d3a2a74985b2 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:35:47 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:47 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=21, name=volume-9afc874f-1797-4c41-a87c-d3a2a74985b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 1073741824" returned: 0 in 0.584s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2" returned: 0 in 0.187s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] <== create_volume: return (920ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5388ef6-0689-415e-a279-a4a0ead58781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afc874f-1797-4c41-a87c-d3a2a74985b2', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bc0657-073c-4406-9579-4c8fc2545058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:48 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Volume volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 (9afc874f-1797-4c41-a87c-d3a2a74985b2): created successfully
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bc0657-073c-4406-9579-4c8fc2545058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (75164a6c-ce7f-4687-b5ff-48b8b16b9a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8257c8e7-b30b-4e06-8bea-7396b8a1ee56]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6a39b6b0-16db-4283-8b0a-5adecdd1c0b9 tempest-VolumesListAdminTestJSON-327737864 None] Created volume successfully.
Sep 25 19:35:49 devstack quobyte-client[83978]: System call of process 86531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510" returned: 0 in 0.907s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-098fe011-91ed-4ec0-a38b-bbf89f401510', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d234c91-42d0-4ef0-9e6e-32f814c61ba3', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:35:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (d6a2b706-1ca0-41cb-a9be-7e8e8904e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd19db3-c285-405f-aa41-d55e1323fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd19db3-c285-405f-aa41-d55e1323fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-781333399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddeb483-f618-4557-bfa8-2972ce137dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:50Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe43de90-fc84-4c4a-ac22-576d1e66327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe43de90-fc84-4c4a-ac22-576d1e66327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420cb2b9-c1ec-4abe-aa23-bdff424667f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420cb2b9-c1ec-4abe-aa23-bdff424667f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddeb483-f618-4557-bfa8-2972ce137dd7', 'volume_name': 'volume-eddeb483-f618-4557-bfa8-2972ce137dd7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655ff5b4-867e-431f-aa1a-9379e1ed2c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655ff5b4-867e-431f-aa1a-9379e1ed2c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af574f0-649f-47ba-a576-de30df9623ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:50 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Volume eddeb483-f618-4557-bfa8-2972ce137dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddeb483-f618-4557-bfa8-2972ce137dd7', 'volume_size': 1}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-781333399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddeb483-f618-4557-bfa8-2972ce137dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83dc06c0feb64cc287cef8def77bbfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:50Z,use_quota=True,user_id='0b4069edfae2489280d42149dd035fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Creating volume eddeb483-f618-4557-bfa8-2972ce137dd7 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:35:50 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:35:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:50 devstack quobyte-client[83978]: System call of process 86534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:50 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=22, name=volume-eddeb483-f618-4557-bfa8-2972ce137dd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-2a84955b-6461-4f18-87e8-d897aba2fee9 req-ba9c2f62-c584-4afe-a729-d19d186cfef2 tempest-DeleteServersTestJSON-703666321 None] attachment_update completed successfully.
Sep 25 19:35:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7 1073741824" returned: 0 in 0.711s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7" returned: 0 in 0.214s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] <== create_volume: return (1023ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:35:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af574f0-649f-47ba-a576-de30df9623ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddeb483-f618-4557-bfa8-2972ce137dd7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01e64fc-4b4c-4151-9a4b-5dfc8d5ab643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:52 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Volume volume-eddeb483-f618-4557-bfa8-2972ce137dd7 (eddeb483-f618-4557-bfa8-2972ce137dd7): created successfully
Sep 25 19:35:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01e64fc-4b4c-4151-9a4b-5dfc8d5ab643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Flow 'volume_create_manager' (d6a2b706-1ca0-41cb-a9be-7e8e8904e986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:52 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5350b39c-dd51-4296-8c8a-bc844a06b2f2 tempest-VolumesListAdminTestJSON-327737864 None] Created volume successfully.
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.283s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:35:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Flow 'volume_create_manager' (3e33ab2b-fb6f-4ba9-a7da-3236315cca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b12278c-d237-42bf-ad8e-923b922312f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b12278c-d237-42bf-ad8e-923b922312f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a046d0bc-1930-46a1-94cf-071bdce8a7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735b87e4625f40969b4f988d0bdb2457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:55Z,use_quota=True,user_id='ce21b62c0f034c99b8a249f5da83cede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e168fc89-09b9-4cec-97e1-4c67e6b9554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e168fc89-09b9-4cec-97e1-4c67e6b9554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbc9b88-1a4a-4981-aa1b-fccca6e6c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbc9b88-1a4a-4981-aa1b-fccca6e6c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a046d0bc-1930-46a1-94cf-071bdce8a7a4', 'volume_name': 'volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ec793a-584b-4afa-9a7a-e49e62ef63be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ec793a-584b-4afa-9a7a-e49e62ef63be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c73cb-9b60-4153-8dbe-e9860e7cea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Volume a046d0bc-1930-46a1-94cf-071bdce8a7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4', 'volume_size': 1}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a046d0bc-1930-46a1-94cf-071bdce8a7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735b87e4625f40969b4f988d0bdb2457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:35:55Z,use_quota=True,user_id='ce21b62c0f034c99b8a249f5da83cede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Creating volume a046d0bc-1930-46a1-94cf-071bdce8a7a4 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:35:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:35:56 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:56 devstack quobyte-client[83978]: System call of process 86926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:35:56 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=23, name=volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 1073741824" returned: 0 in 0.688s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4" returned: 0 in 0.224s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] <== create_volume: return (1066ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c73cb-9b60-4153-8dbe-e9860e7cea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ce058c-60ec-47b9-bdc8-77b67af1bfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:35:57 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Volume volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 (a046d0bc-1930-46a1-94cf-071bdce8a7a4): created successfully
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ce058c-60ec-47b9-bdc8-77b67af1bfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:35:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Flow 'volume_create_manager' (3e33ab2b-fb6f-4ba9-a7da-3236315cca11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:35:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-090c7c99-b8d0-451b-a07c-53ee58b10ef2 tempest-VolumesListAdminTestJSON-2018857611 None] Created volume successfully.
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Acquiring lock "cinder-a046d0bc-1930-46a1-94cf-071bdce8a7a4-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "cinder-a046d0bc-1930-46a1-94cf-071bdce8a7a4-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-eddeb483-f618-4557-bfa8-2972ce137dd7-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-eddeb483-f618-4557-bfa8-2972ce137dd7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Acquiring lock "cinder-quobyte-a046d0bc-1930-46a1-94cf-071bdce8a7a4" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "cinder-quobyte-a046d0bc-1930-46a1-94cf-071bdce8a7a4" acquired by "delete_volume" :: waited 0.059s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-quobyte-eddeb483-f618-4557-bfa8-2972ce137dd7" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359d977-4ebe-4ba0-b2ed-7cd31aec0143]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:35:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-eddeb483-f618-4557-bfa8-2972ce137dd7" acquired by "delete_volume" :: waited 0.326s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:35:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d1526-1d41-48d4-8f0c-1fec489db631]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:35:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4" returned: 0 in 1.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7" returned: 0 in 0.854s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a046d0bc-1930-46a1-94cf-071bdce8a7a4" returned: 0 in 0.374s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-eddeb483-f618-4557-bfa8-2972ce137dd7" returned: 0 in 0.334s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "cinder-quobyte-a046d0bc-1930-46a1-94cf-071bdce8a7a4" released by "delete_volume" :: held 1.885s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-eddeb483-f618-4557-bfa8-2972ce137dd7" released by "delete_volume" :: held 1.904s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Created reservations ['f4bdb642-aa55-49de-9cd9-95e90e2e5a39', 'c15e47ea-2ece-412b-8bdd-94c8ce876a9d', 'b7d8a15d-3c62-4c48-a12d-35663ba3beb7', 'be7baee0-fd33-4f70-b8c4-436a619cde81'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Created reservations ['af6f3418-65eb-41e6-81ac-2896bc25002b', '19b57843-181c-4454-b61a-4474c5e93cc2', 'd3478b0d-7e80-42cc-846e-59e551893eab', '9fa7e464-a7dc-48a1-a25a-319ce79db232'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.185s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 1.011s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:03 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-9afc874f-1797-4c41-a87c-d3a2a74985b2-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Deleted volume successfully.
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 1.994s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Deleted volume successfully.
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-9afc874f-1797-4c41-a87c-d3a2a74985b2-delete_volume" acquired by "delete_volume" :: waited 0.440s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2f90a1f-af4c-4757-84b8-ea6c2189ea1e tempest-VolumesListAdminTestJSON-2018857611 None] Lock "cinder-a046d0bc-1930-46a1-94cf-071bdce8a7a4-delete_volume" released by "delete_volume" :: held 5.978s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c62ec9d3-782c-4233-950b-34beee4b0b79 tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-eddeb483-f618-4557-bfa8-2972ce137dd7-delete_volume" released by "delete_volume" :: held 5.914s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-quobyte-9afc874f-1797-4c41-a87c-d3a2a74985b2" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-9afc874f-1797-4c41-a87c-d3a2a74985b2" acquired by "delete_volume" :: waited 0.024s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c13497c-c64e-4da2-b038-40381c0ebc5f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:06 devstack quobyte-client[83978]: System call of process 86991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:06 devstack quobyte-client[83978]: System call of process 86991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:06 devstack quobyte-client[83978]: System call of process 86991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2" returned: 0 in 1.688s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9afc874f-1797-4c41-a87c-d3a2a74985b2" returned: 0 in 0.326s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-9afc874f-1797-4c41-a87c-d3a2a74985b2" released by "delete_volume" :: held 2.433s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:07 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Created reservations ['329103d4-43ef-4da2-a130-32700bc5bd8c', '72fdfb54-f27e-496b-b586-e886589d37be', 'c1446b07-1e72-4a04-b4ef-3b3f2702f9a4', '3d9655e0-f010-41f8-af88-d1f212932099'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-63154e73-d6cc-4905-aba3-390679f3e848 req-60f715d2-685f-4ca4-a759-847ae0f95f43 tempest-DeleteServersTestJSON-703666321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-c021816d-402e-474d-8d91-fc553eb3b8ab-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-63154e73-d6cc-4905-aba3-390679f3e848 req-60f715d2-685f-4ca4-a759-847ae0f95f43 tempest-DeleteServersTestJSON-703666321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-63154e73-d6cc-4905-aba3-390679f3e848 req-60f715d2-685f-4ca4-a759-847ae0f95f43 tempest-DeleteServersTestJSON-703666321 None] Terminate volume connection completed successfully.
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-63154e73-d6cc-4905-aba3-390679f3e848 req-60f715d2-685f-4ca4-a759-847ae0f95f43 tempest-DeleteServersTestJSON-703666321 None] Deleting attachment 1d234c91-42d0-4ef0-9e6e-32f814c61ba3. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-c021816d-402e-474d-8d91-fc553eb3b8ab-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.984s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Deleted volume successfully.
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a0e34ff0-7c68-49cb-93ea-ded44299aacb tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-9afc874f-1797-4c41-a87c-d3a2a74985b2-delete_volume" released by "delete_volume" :: held 5.204s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "cinder-quobyte-c021816d-402e-474d-8d91-fc553eb3b8ab" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-c021816d-402e-474d-8d91-fc553eb3b8ab" acquired by "delete_volume" :: waited 0.061s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c99dfe0-d78c-462a-ae4c-d63782f14710]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:10 devstack quobyte-client[83978]: System call of process 87117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:10 devstack quobyte-client[83978]: System call of process 87117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab" returned: 0 in 0.757s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c021816d-402e-474d-8d91-fc553eb3b8ab" returned: 0 in 0.212s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-quobyte-c021816d-402e-474d-8d91-fc553eb3b8ab" released by "delete_volume" :: held 1.234s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Created reservations ['8a1b1107-9654-46c5-a5cc-53b8904ca166', '0c493065-ae1f-4554-9c81-f26656aeac67', '26967330-8d34-4e6d-a2a4-cf3e3a4badc2', '909213c2-76dd-434e-bb21-414df7be020a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.228s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:11 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:11 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Deleted volume successfully.
Sep 25 19:36:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-455604a9-ee30-4e1b-9fa2-bbe93375c11d tempest-VolumesListAdminTestJSON-327737864 None] Lock "cinder-c021816d-402e-474d-8d91-fc553eb3b8ab-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "cinder-098fe011-91ed-4ec0-a38b-bbf89f401510-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "cinder-098fe011-91ed-4ec0-a38b-bbf89f401510-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "cinder-quobyte-098fe011-91ed-4ec0-a38b-bbf89f401510" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "cinder-quobyte-098fe011-91ed-4ec0-a38b-bbf89f401510" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b043c-b64d-4205-b53e-ba6b0a8a217c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:14 devstack quobyte-client[83978]: System call of process 87124 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510" returned: 0 in 0.612s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-098fe011-91ed-4ec0-a38b-bbf89f401510" returned: 0 in 0.171s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "cinder-quobyte-098fe011-91ed-4ec0-a38b-bbf89f401510" released by "delete_volume" :: held 1.005s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:14 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Created reservations ['9b8107aa-1e1a-458b-b599-d916015bf351', '84901da0-18c0-4c9a-b7e2-c68a052df9ed', 'b63f671e-5773-496d-b80f-be2b88d6e00b', 'e2788a1f-0896-440e-b3f1-42ad97dd62f5'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Deleted volume successfully.
Sep 25 19:36:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fbb1925f-296a-45c0-a479-1b12a9654f7c tempest-DeleteServersTestJSON-703666321 None] Lock "cinder-098fe011-91ed-4ec0-a38b-bbf89f401510-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Flow 'volume_create_manager' (2c557dfb-1a47-4210-9295-5912b36c3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddef6f9-d64c-4e8f-93f5-5850919b4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddef6f9-d64c-4e8f-93f5-5850919b4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1253191194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099a1ba4-7c4d-4a0e-aa55-041cd92d48c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21ef561a47d4812a850337d12ce6732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:20Z,use_quota=True,user_id='c37eee1be4c941cdb3e6e31fffb75d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf023e90-4ccf-4ccd-8e6c-1e8089ae4af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf023e90-4ccf-4ccd-8e6c-1e8089ae4af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aad075-5f86-496b-ac04-f063df2d4250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:19 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 19:36:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aad075-5f86-496b-ac04-f063df2d4250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '099a1ba4-7c4d-4a0e-aa55-041cd92d48c4', 'volume_name': 'volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97908b77f0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4344e554-1a75-4e83-aa7b-6a4fa7f7fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4344e554-1a75-4e83-aa7b-6a4fa7f7fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c40bd50-bbeb-42e5-9ad4-c72734e56c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97908b77f0>}
Sep 25 19:36:20 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Cloning 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 from image 926ecad1-382a-474f-abd8-fe37d592162a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 19:36:21 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 19:36:21 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 19:36:21 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b17d87-669d-4d99-9b54-3c004a9170d1]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:21 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD
Sep 25 19:36:21 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:36:23 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD" returned: 0 in 2.220s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a is fetched for user c37eee1be4c941cdb3e6e31fffb75d1a. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=41,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=9 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=61,cinder:SELECT=37,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5671c7c9-f93b-4324-bcc4-0f95ec6c523e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:24 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD
Sep 25 19:36:24 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:36:26 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD" returned: 0 in 2.515s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1253191194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099a1ba4-7c4d-4a0e-aa55-041cd92d48c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21ef561a47d4812a850337d12ce6732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:20Z,use_quota=True,user_id='c37eee1be4c941cdb3e6e31fffb75d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Creating volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.135s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:36:26 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:36:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:26 devstack quobyte-client[83978]: System call of process 87165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:26 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=24, name=volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:36:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 1073741824" returned: 0 in 0.606s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 0 in 0.186s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:36:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:28 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Attempting download of 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 19:36:28 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9fb7e-7843-4ce0-9c98-d313a6fe8009]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_ch4a88m_ {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_ch4a88m_" returned: 0 in 0.869s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_ch4a88m_ {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_ch4a88m_" returned: 1 in 0.843s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_ch4a88m_' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fd451-6df1-462b-8ed3-bc32f2577f52]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] 926ecad1-382a-474f-abd8-fe37d592162a was qcow2, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 19:36:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:30 devstack quobyte-client[83978]: System call of process 87186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:30 devstack quobyte-client[83978]: System call of process 87186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:31 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=24, name=volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 0 in 1.496s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_cvnmnx6rdevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 19:36:32 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Converted 112.00 MB image at 72.06 MB/s
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 1G" returned: 0 in 0.235s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19b271-2628-4440-8f99-a3ee6b22896d]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 0 in 0.494s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 1 in 0.855s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Downloaded image 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a for user c37eee1be4c941cdb3e6e31fffb75d1a is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Marking volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Copying metadata from image 926ecad1-382a-474f-abd8-fe37d592162a to 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 19:36:34 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Creating volume glance metadata for volume 099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 backed by image 926ecad1-382a-474f-abd8-fe37d592162a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 19:36:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c40bd50-bbeb-42e5-9ad4-c72734e56c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97908b77f0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ff5378-760f-4c6a-93ba-6568de51afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Volume volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 (099a1ba4-7c4d-4a0e-aa55-041cd92d48c4): created successfully
Sep 25 19:36:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ff5378-760f-4c6a-93ba-6568de51afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Flow 'volume_create_manager' (2c557dfb-1a47-4210-9295-5912b36c3154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bac32914-675a-491c-a893-d13f1f65d773 tempest-VolumesImageMetadata-1738215094 None] Created volume successfully.
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Acquiring lock "cinder-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "cinder-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Acquiring lock "cinder-quobyte-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "cinder-quobyte-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[de855e1a-e7ac-47eb-9d24-2c9a79edd350]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:38 devstack quobyte-client[83978]: System call of process 87215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 0 in 0.617s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:38 devstack quobyte-client[83978]: System call of process 87217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:38 devstack quobyte-client[83978]: System call of process 87217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:38 devstack quobyte-client[83978]: System call of process 87217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 1 in 0.597s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:36:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" returned: 0 in 0.200s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "cinder-quobyte-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4" released by "delete_volume" :: held 1.747s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:39 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Created reservations ['a7d924c6-840b-4c80-b3bb-408d5ecd56aa', '06c2fbfa-ee1d-463b-9d0a-c922731be0ab', 'f1331b27-7abe-4de6-a8f9-cd8a03fc5bbe', 'b212b1e1-0f6d-4204-8211-e72f4d18e1d4'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Deleted volume successfully.
Sep 25 19:36:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6f59d8ce-49a5-496a-94e2-aca42d09fd53 tempest-VolumesImageMetadata-1738215094 None] Lock "cinder-099a1ba4-7c4d-4a0e-aa55-041cd92d48c4-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (4891a748-d0b4-4cc5-93fb-9860bd4eee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200546f-2532-4cf4-9440-abc8189b30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200546f-2532-4cf4-9440-abc8189b30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1195291800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca52bf-98ff-4173-bccd-95ae7b36f7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:44Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8e7c9a-4904-46f4-9f36-0c9b85b72906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8e7c9a-4904-46f4-9f36-0c9b85b72906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bbdb05-7719-4f48-93cf-6cfa3a1d2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bbdb05-7719-4f48-93cf-6cfa3a1d2762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eca52bf-98ff-4173-bccd-95ae7b36f7d3', 'volume_name': 'volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e9a241-1f6f-4601-a5b7-2fa005236edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e9a241-1f6f-4601-a5b7-2fa005236edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0dd302-6317-4260-8323-23a8165704fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:44 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Volume 9eca52bf-98ff-4173-bccd-95ae7b36f7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3', 'volume_size': 1}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1195291800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca52bf-98ff-4173-bccd-95ae7b36f7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:44Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Creating volume 9eca52bf-98ff-4173-bccd-95ae7b36f7d3 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:36:44 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:36:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:44 devstack quobyte-client[83978]: System call of process 87235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:44 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=25, name=volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:36:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 1073741824" returned: 0 in 0.965s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:45 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Flow 'volume_create_manager' (5c055b89-70df-4196-92ba-36599f18c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec4e53e-eed8-42b7-9d96-f70c35c9957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" returned: 0 in 0.628s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] <== create_volume: return (1661ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec4e53e-eed8-42b7-9d96-f70c35c9957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2060898501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7271bf12-dd97-45b7-955c-eb61458ac988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af143af9d95b444987a621953e45e3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:45Z,use_quota=True,user_id='daad5f4ee7394db78c2c22929a820993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf39948-b04c-4c6e-85fa-6e0cb870fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf39948-b04c-4c6e-85fa-6e0cb870fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31ce62f-dd67-4c69-b5d4-30f0a76f2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31ce62f-dd67-4c69-b5d4-30f0a76f2000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7271bf12-dd97-45b7-955c-eb61458ac988', 'volume_name': 'volume-7271bf12-dd97-45b7-955c-eb61458ac988', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe647e7-1a89-4701-9e66-f971adda9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe647e7-1a89-4701-9e66-f971adda9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b20cef-0750-4842-954d-90b1a6b20719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:46 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Volume 7271bf12-dd97-45b7-955c-eb61458ac988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7271bf12-dd97-45b7-955c-eb61458ac988', 'volume_size': 1}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2060898501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7271bf12-dd97-45b7-955c-eb61458ac988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af143af9d95b444987a621953e45e3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:36:45Z,use_quota=True,user_id='daad5f4ee7394db78c2c22929a820993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Creating volume 7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:36:46 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:46 devstack quobyte-client[83978]: System call of process 87241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:46 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=26, name=volume-7271bf12-dd97-45b7-955c-eb61458ac988, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0dd302-6317-4260-8323-23a8165704fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756300b-9240-4fab-9eea-d77fa50b1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 1073741824" returned: 0 in 0.571s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Volume volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 (9eca52bf-98ff-4173-bccd-95ae7b36f7d3): created successfully
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756300b-9240-4fab-9eea-d77fa50b1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (4891a748-d0b4-4cc5-93fb-9860bd4eee1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988" returned: 0 in 0.785s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] <== create_volume: return (1386ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9372d409-4eff-4ceb-b86c-2b6c42ebad45 tempest-AttachVolumeTestJSON-1604430487 None] Created volume successfully.
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b20cef-0750-4842-954d-90b1a6b20719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7271bf12-dd97-45b7-955c-eb61458ac988', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606418b7-a4e5-40c1-82db-92f19574ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:36:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Volume volume-7271bf12-dd97-45b7-955c-eb61458ac988 (7271bf12-dd97-45b7-955c-eb61458ac988): created successfully
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606418b7-a4e5-40c1-82db-92f19574ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:36:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Flow 'volume_create_manager' (5c055b89-70df-4196-92ba-36599f18c15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:36:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-355a98fb-5d53-4a1e-b432-849d8e733a05 tempest-SnapshotMetadataTestJSON-206634210 None] Created volume successfully.
Sep 25 19:36:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Creating offline snapshot abd2ed9a-7725-429f-931e-fa730269fcf5 of volume 7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:36:49 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d3e94a-6749-4eef-8313-7aaec5a04108]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988" returned: 0 in 0.938s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:50 devstack quobyte-client[83978]: System call of process 87248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:50 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=27, name=volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:36:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 1G" returned: 0 in 0.349s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7271bf12-dd97-45b7-955c-eb61458ac988 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:50 devstack quobyte-client[83978]: System call of process 87253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:50 devstack quobyte-client[83978]: System call of process 87253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "qemu-img rebase -u -b volume-7271bf12-dd97-45b7-955c-eb61458ac988 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.233s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.171s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.159s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.info" returned: 0 in 0.444s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.info" returned: 0 in 0.315s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.101s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83ba2e-ad3f-41f1-af52-a40d885e2dfa]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3ef741a4-0f2d-4ff2-812a-491b30437485 tempest-SnapshotMetadataTestJSON-206634210 None] Create snapshot completed successfully
Sep 25 19:36:53 devstack quobyte-client[83978]: System call of process 87267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" returned: 0 in 0.589s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b679199a-04a3-428a-9637-5d68f9beb438', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:36:53 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-9bdb9b50-003b-4e3b-a5c4-666300b656cc req-d53b6ad7-05e8-4206-b3ec-f7503e42d389 tempest-AttachVolumeTestJSON-1604430487 None] attachment_update completed successfully.
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.161s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "cinder-abd2ed9a-7725-429f-931e-fa730269fcf5-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-abd2ed9a-7725-429f-931e-fa730269fcf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.121s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:54 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "cinder-quobyte-abd2ed9a-7725-429f-931e-fa730269fcf5" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-abd2ed9a-7725-429f-931e-fa730269fcf5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Deleting offline snapshot abd2ed9a-7725-429f-931e-fa730269fcf5 of volume 7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:36:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] snapshot_file for this snap is: volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[682ddde4-e017-4eaa-b263-912e4416477e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:55 devstack quobyte-client[83978]: System call of process 87338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.472s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7271bf12-dd97-45b7-955c-eb61458ac988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96bc37-3aed-4ead-9945-f59998347e32]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988" returned: 0 in 0.694s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack quobyte-client[83978]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.356s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988.abd2ed9a-7725-429f-931e-fa730269fcf5" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-abd2ed9a-7725-429f-931e-fa730269fcf5" released by "_delete_snapshot" :: held 2.266s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" released by "delete_snapshot" :: held 2.290s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Created reservations ['c2843f02-a8f7-498d-aae9-6d7090123f09', '92afa67b-2fac-4d18-87d5-59bc45fdcdee', 'd8db0792-dcdf-411a-b6cf-ba420ca3e3aa', 'a850c704-8567-46b8-9298-106579dd09f7'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Delete snapshot completed successfully.
Sep 25 19:36:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8e259973-cbaa-434d-b549-f05844705361 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-abd2ed9a-7725-429f-931e-fa730269fcf5-delete_snapshot" released by "delete_snapshot" :: held 2.772s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "cinder-7271bf12-dd97-45b7-955c-eb61458ac988-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-7271bf12-dd97-45b7-955c-eb61458ac988-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" acquired by "delete_volume" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5272e78-23a3-4541-adf3-228552f441b7]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:58 devstack quobyte-client[83978]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:58 devstack quobyte-client[83978]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:58 devstack quobyte-client[83978]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:58 devstack quobyte-client[83978]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988" returned: 0 in 0.495s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7271bf12-dd97-45b7-955c-eb61458ac988" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-quobyte-7271bf12-dd97-45b7-955c-eb61458ac988" released by "delete_volume" :: held 0.815s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Created reservations ['4c985e65-b6c8-4708-9733-1051668bc80b', 'a976a9ec-6d00-4f94-9f7c-f86fffaca879', 'c646f77d-78b0-4a21-9d73-cde26c97c352', 'de67e2ec-7839-45bd-bf51-6768bedec7ae'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.113s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:36:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Deleted volume successfully.
Sep 25 19:36:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-019aa37e-f171-42e6-ab16-57731ee77410 tempest-SnapshotMetadataTestJSON-206634210 None] Lock "cinder-7271bf12-dd97-45b7-955c-eb61458ac988-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Flow 'volume_create_manager' (0e31c793-7ee7-4f09-9cc2-c6eee72a57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486ed786-b145-4ec8-a4e1-edd04ba0a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486ed786-b145-4ec8-a4e1-edd04ba0a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-37282264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e49ea16-5706-40d6-9d0d-10043b2370a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c0590f24dafa8ef18e1d5bc31a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:04Z,use_quota=True,user_id='fe9ffd6c75db4f89a80fdf14d8e7e853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57406216-7e4d-4194-9b93-244e31e48720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57406216-7e4d-4194-9b93-244e31e48720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa70b065-3993-4e41-98fe-bcc5ff9218ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa70b065-3993-4e41-98fe-bcc5ff9218ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e49ea16-5706-40d6-9d0d-10043b2370a5', 'volume_name': 'volume-6e49ea16-5706-40d6-9d0d-10043b2370a5', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9ac24c-a630-497b-8c02-f87863b96d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9ac24c-a630-497b-8c02-f87863b96d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2419e4-4095-48d8-8ddf-cee6d8cc0aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:04 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Volume 6e49ea16-5706-40d6-9d0d-10043b2370a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e49ea16-5706-40d6-9d0d-10043b2370a5', 'volume_size': 1}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-37282264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e49ea16-5706-40d6-9d0d-10043b2370a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c0590f24dafa8ef18e1d5bc31a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:04Z,use_quota=True,user_id='fe9ffd6c75db4f89a80fdf14d8e7e853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Creating volume 6e49ea16-5706-40d6-9d0d-10043b2370a5 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:37:04 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:37:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:04 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=29, name=volume-6e49ea16-5706-40d6-9d0d-10043b2370a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 1073741824" returned: 0 in 0.381s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5" returned: 0 in 0.161s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2419e4-4095-48d8-8ddf-cee6d8cc0aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e49ea16-5706-40d6-9d0d-10043b2370a5', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6149c07-8a0b-4d93-8a1c-15f7795f4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:05 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Volume volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 (6e49ea16-5706-40d6-9d0d-10043b2370a5): created successfully
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6149c07-8a0b-4d93-8a1c-15f7795f4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Flow 'volume_create_manager' (0e31c793-7ee7-4f09-9cc2-c6eee72a57b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-95185e02-bec7-4adb-89f5-454ac8d9aea7 tempest-TaggedAttachmentsTest-2095767279 None] Created volume successfully.
Sep 25 19:37:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Flow 'volume_create_manager' (86c6dd96-09df-4a30-9120-b105ed14667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc13dd02-b078-4757-8958-768d28302a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc13dd02-b078-4757-8958-768d28302a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-262813407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d58cede-b06e-4bd0-9b89-907e4b47d767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cc72d76c744467b1b44cf9a234ab9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:06Z,use_quota=True,user_id='a5507c1bfe46423da00cc060f712fc97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e0b118-9c61-48af-b2fe-7b42b86d99e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e0b118-9c61-48af-b2fe-7b42b86d99e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076672ca-925f-4ebd-b3e2-f82db3c6e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076672ca-925f-4ebd-b3e2-f82db3c6e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d58cede-b06e-4bd0-9b89-907e4b47d767', 'volume_name': 'volume-1d58cede-b06e-4bd0-9b89-907e4b47d767', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d686f274-8dd4-4bd5-88a7-6c9633bf2123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d686f274-8dd4-4bd5-88a7-6c9633bf2123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a1b2f-cf22-4ae5-b3cb-6a8aa1ce3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:06 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Volume 1d58cede-b06e-4bd0-9b89-907e4b47d767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d58cede-b06e-4bd0-9b89-907e4b47d767', 'volume_size': 1}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-262813407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d58cede-b06e-4bd0-9b89-907e4b47d767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cc72d76c744467b1b44cf9a234ab9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:06Z,use_quota=True,user_id='a5507c1bfe46423da00cc060f712fc97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Creating volume 1d58cede-b06e-4bd0-9b89-907e4b47d767 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:37:06 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:37:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:06 devstack quobyte-client[83978]: System call of process 87716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:06 devstack quobyte-client[83978]: System call of process 87716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:06 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=30, name=volume-1d58cede-b06e-4bd0-9b89-907e4b47d767, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 1073741824" returned: 0 in 0.422s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] <== create_volume: return (624ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.638s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a1b2f-cf22-4ae5-b3cb-6a8aa1ce3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d58cede-b06e-4bd0-9b89-907e4b47d767', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec19cc20-2d21-4895-9dc8-4c1e45567ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Volume volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 (1d58cede-b06e-4bd0-9b89-907e4b47d767): created successfully
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec19cc20-2d21-4895-9dc8-4c1e45567ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Flow 'volume_create_manager' (86c6dd96-09df-4a30-9120-b105ed14667b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:07 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-39e22d8f-3807-4264-a13c-85d70239cabd tempest-AbsoluteLimitsTests-2140897455 None] Created volume successfully.
Sep 25 19:37:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Acquiring lock "cinder-1d58cede-b06e-4bd0-9b89-907e4b47d767-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "cinder-1d58cede-b06e-4bd0-9b89-907e4b47d767-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Acquiring lock "cinder-quobyte-1d58cede-b06e-4bd0-9b89-907e4b47d767" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "cinder-quobyte-1d58cede-b06e-4bd0-9b89-907e4b47d767" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc556b0-5f2e-41e3-a835-998904cb140c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:09 devstack quobyte-client[83978]: System call of process 87720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:09 devstack quobyte-client[83978]: System call of process 87720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767" returned: 0 in 0.613s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1d58cede-b06e-4bd0-9b89-907e4b47d767" returned: 0 in 0.237s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "cinder-quobyte-1d58cede-b06e-4bd0-9b89-907e4b47d767" released by "delete_volume" :: held 1.289s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Created reservations ['c71bc3bc-5a1f-43e8-9db6-16a96e5b4e04', '8adafd04-013c-4c7d-912a-478de4c9a89f', 'e613daab-f16d-402c-8746-babdf91226f1', '439b555b-8ace-4c73-9d3e-51b9aae9e7b2'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.106s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:10 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:37:10 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Deleted volume successfully.
Sep 25 19:37:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7016a094-c51c-4420-9769-a1171028cd9c tempest-AbsoluteLimitsTests-2140897455 None] Lock "cinder-1d58cede-b06e-4bd0-9b89-907e4b47d767-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Flow 'volume_create_manager' (752b7371-e99a-490b-9374-08cc45972cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f34158b-62c2-4ad4-852a-aefcc1f8a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f34158b-62c2-4ad4-852a-aefcc1f8a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-283095673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a4ed2bba364b278bbb6872de0c7098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:19Z,use_quota=True,user_id='5e4300e555c8442ba38c04b4216ff34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbf6ad7-3341-45bc-aae3-ba05a2b4592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbf6ad7-3341-45bc-aae3-ba05a2b4592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d5e205-9f2a-4396-8a0a-3f39d603fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d5e205-9f2a-4396-8a0a-3f39d603fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a', 'volume_name': 'volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c1cab-caed-4bb5-9102-a86a7e2557d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c1cab-caed-4bb5-9102-a86a7e2557d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9750c6-bc08-4c4a-9e5e-c78beb94d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:19 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Volume 1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a', 'volume_size': 1}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-283095673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a4ed2bba364b278bbb6872de0c7098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:19Z,use_quota=True,user_id='5e4300e555c8442ba38c04b4216ff34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Creating volume 1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:37:19 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:37:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:20 devstack quobyte-client[83978]: System call of process 88199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:20 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=31, name=volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:37:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a 1073741824" returned: 0 in 1.006s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" returned: 0 in 0.491s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] <== create_volume: return (1747ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:37:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9750c6-bc08-4c4a-9e5e-c78beb94d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550dec47-efae-495f-889d-66c4428e83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:22 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Volume volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a (1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a): created successfully
Sep 25 19:37:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550dec47-efae-495f-889d-66c4428e83fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Flow 'volume_create_manager' (752b7371-e99a-490b-9374-08cc45972cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8da5f0f6-00df-4599-bcef-10116eb66608 tempest-VolumesTransfersV357Test-25744939 None] Created volume successfully.
Sep 25 19:37:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-51ec2dd8-e529-44a0-b130-9cc6edbf2bd6 tempest-VolumesTransfersV357Test-1805953630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:25 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:INSERT=9,cinder:UPDATE=58,cinder:SELECT=38,cinder:DELETE=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:37:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-51ec2dd8-e529-44a0-b130-9cc6edbf2bd6 tempest-VolumesTransfersV357Test-1805953630 None] Transfer volume completed successfully.
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "cinder-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=33,cinder:SELECT=39,cinder:INSERT=20,cinder:DELETE=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:37:27 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "cinder-quobyte-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-quobyte-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" acquired by "delete_volume" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[14880b81-8120-4289-91c2-bbcc89aaf3a6]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:37:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" returned: 0 in 0.570s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" returned: 0 in 0.135s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-quobyte-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a" released by "delete_volume" :: held 1.161s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Created reservations ['5fb2471d-1aed-4d51-93f9-b86e1220ee63', 'a3905073-7f37-42fc-a8e3-557fe991f1dc', '58a5b550-02dd-4066-a560-1af9e796b89d', 'd0f612a6-0ed8-4ed1-a905-593867dfbd2b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.187s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:30 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:37:30 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Deleted volume successfully.
Sep 25 19:37:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a76ec4fb-cbcc-41e6-b02f-2fca6b72898d tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-1c3e9869-098b-4fa3-8acd-f90ec5c7aa6a-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Flow 'volume_create_manager' (c22e36c8-0c95-48de-9114-6b401838af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ce9f60-dd5e-4d6e-8ced-b153ccabb44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ce9f60-dd5e-4d6e-8ced-b153ccabb44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-939558541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dec5873-d43e-4770-ad6a-cf6a12c9e6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a4ed2bba364b278bbb6872de0c7098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:32Z,use_quota=True,user_id='5e4300e555c8442ba38c04b4216ff34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf80ca5-f800-4fd2-831e-b90c95ddb0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf80ca5-f800-4fd2-831e-b90c95ddb0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c58e00e-c8c0-4236-9ec8-5f9650c087d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c58e00e-c8c0-4236-9ec8-5f9650c087d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dec5873-d43e-4770-ad6a-cf6a12c9e6d1', 'volume_name': 'volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b0dcfc-c804-4c32-8821-3d6112a88112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b0dcfc-c804-4c32-8821-3d6112a88112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52701724-e68c-4049-a31f-5ca5cf69aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Volume 7dec5873-d43e-4770-ad6a-cf6a12c9e6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1', 'volume_size': 1}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-939558541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dec5873-d43e-4770-ad6a-cf6a12c9e6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a4ed2bba364b278bbb6872de0c7098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:32Z,use_quota=True,user_id='5e4300e555c8442ba38c04b4216ff34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Creating volume 7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:37:32 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:37:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:32 devstack quobyte-client[83978]: System call of process 88297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:32 devstack quobyte-client[83978]: System call of process 88297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:37:32 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=32, name=volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 1073741824" returned: 0 in 0.739s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52701724-e68c-4049-a31f-5ca5cf69aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0929f2a-1938-4590-b859-784bedb407b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Volume volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 (7dec5873-d43e-4770-ad6a-cf6a12c9e6d1): created successfully
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0929f2a-1938-4590-b859-784bedb407b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Flow 'volume_create_manager' (c22e36c8-0c95-48de-9114-6b401838af56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-56728192-6dfb-4b1b-8f6c-6728482257f6 tempest-VolumesTransfersV357Test-25744939 None] Created volume successfully.
Sep 25 19:37:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "cinder-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:34 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "cinder-quobyte-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:37:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-quobyte-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:37:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef65c72-d6f8-41e3-bc0f-b47175702b42]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:37:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" returned: 0 in 0.731s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" returned: 0 in 0.363s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-quobyte-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1" released by "delete_volume" :: held 1.403s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Created reservations ['6acebcbd-fdf2-4a16-bc85-20f3487399a3', 'd261d60b-7e1c-42dc-9c50-c399adf20f83', '725ff5d5-0def-41c5-afae-a41669b94272', 'ecfeadaf-3465-4768-a343-d43ceda58caa'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.142s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:37 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:37:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Deleted volume successfully.
Sep 25 19:37:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bd1057c9-e491-445d-a1a2-b89fbf87afaa tempest-VolumesTransfersV357Test-601986568 None] Lock "cinder-7dec5873-d43e-4770-ad6a-cf6a12c9e6d1-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:37:47 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=14,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:37:48 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:37:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:37:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.281s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:37:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:37:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Flow 'volume_create_manager' (5973a51d-0efe-4e5c-b886-3e64d8007f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7789221-286a-4a02-9320-1a21cb6ce52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7789221-286a-4a02-9320-1a21cb6ce52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-382760214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e7edbb-47a1-4897-a7d7-5d214cf97bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d0d1723a2428bbaea758b80ae2dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:56Z,use_quota=True,user_id='35c6893cde2e4702b0b7df849a6f03d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79987853-18d9-41f6-b3a0-9bd5a32dc421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79987853-18d9-41f6-b3a0-9bd5a32dc421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ef7eb-0fa1-4018-b846-ddbc3a50419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:56 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ef7eb-0fa1-4018-b846-ddbc3a50419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5e7edbb-47a1-4897-a7d7-5d214cf97bfa', 'volume_name': 'volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790e64d00>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836f6dc7-d6e2-4824-91e6-23141ef146c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836f6dc7-d6e2-4824-91e6-23141ef146c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c0fa7-456f-4c77-8acb-ae956f604e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:37:57 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790e64d00>}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Cloning c5e7edbb-47a1-4897-a7d7-5d214cf97bfa from image 926ecad1-382a-474f-abd8-fe37d592162a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 19:37:57 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[31477389-63ce-4a0e-af31-93bd932ea57e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:37:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:37:58 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD
Sep 25 19:37:58 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:38:00 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Sep 25 19:38:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD" returned: 0 in 2.705s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:00 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a is fetched for user 35c6893cde2e4702b0b7df849a6f03d9. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 19:38:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a42e5-8207-4f79-a965-561828b8a9a9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:01 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD
Sep 25 19:38:01 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:38:03 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD" returned: 0 in 2.391s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-382760214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e7edbb-47a1-4897-a7d7-5d214cf97bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d0d1723a2428bbaea758b80ae2dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:37:56Z,use_quota=True,user_id='35c6893cde2e4702b0b7df849a6f03d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Creating volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:38:03 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:03 devstack quobyte-client[83978]: System call of process 88443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:03 devstack quobyte-client[83978]: System call of process 88443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:03 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=33, name=volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 1073741824" returned: 0 in 0.517s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 0.160s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] <== create_volume: return (820ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Attempting download of 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc912557-eeb2-4b23-bb11-e9a61ea95027]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dv1d7502 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dv1d7502" returned: 0 in 0.441s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dv1d7502 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dv1d7502" returned: 1 in 0.461s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dv1d7502' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:38:05 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3840c77-e65c-4143-b8e2-7fe5640ec00d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD" returned: 0 in 0.633s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:06 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] 926ecad1-382a-474f-abd8-fe37d592162a was qcow2, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 19:38:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:06 devstack quobyte-client[83978]: System call of process 88454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:06 devstack quobyte-client[83978]: System call of process 88454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:06 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=33, name=volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 1.746s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_d24wp2wgdevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 19:38:08 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Converted 112.00 MB image at 61.51 MB/s
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:08 devstack quobyte-client[83978]: System call of process 88461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:08 devstack quobyte-client[83978]: System call of process 88461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 1G" returned: 0 in 0.359s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931ff8b-2f6c-4851-9c83-bfbb020818b7]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:09 devstack quobyte-client[83978]: System call of process 88465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:09 devstack quobyte-client[83978]: System call of process 88465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:09 devstack quobyte-client[83978]: System call of process 88465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 1.002s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:11 devstack quobyte-client[83978]: System call of process 88467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:11 devstack quobyte-client[83978]: System call of process 88467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 1 in 1.512s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Downloaded image 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a for user 35c6893cde2e4702b0b7df849a6f03d9 is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Marking volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Copying metadata from image 926ecad1-382a-474f-abd8-fe37d592162a to c5e7edbb-47a1-4897-a7d7-5d214cf97bfa. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 19:38:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Creating volume glance metadata for volume c5e7edbb-47a1-4897-a7d7-5d214cf97bfa backed by image 926ecad1-382a-474f-abd8-fe37d592162a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 19:38:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c0fa7-456f-4c77-8acb-ae956f604e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790e64d00>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a2b8c6-c376-4081-a5e6-f71a221d089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Volume volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa (c5e7edbb-47a1-4897-a7d7-5d214cf97bfa): created successfully
Sep 25 19:38:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a2b8c6-c376-4081-a5e6-f71a221d089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Flow 'volume_create_manager' (5973a51d-0efe-4e5c-b886-3e64d8007f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:38:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f525d746-d9ee-49f3-a406-bc06786532be tempest-VolumesExtendTest-1161210201 None] Created volume successfully.
Sep 25 19:38:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:13 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[922656f1-11a9-4d0a-8d82-775d78aadefa]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:14 devstack quobyte-client[83978]: System call of process 88503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 0.416s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 1 in 0.461s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 2G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa 2G" returned: 0 in 0.167s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.223s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8f4c390e-07d5-4a34-9079-8e4d211d53be tempest-VolumesExtendTest-1161210201 None] Extend volume completed successfully.
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-quobyte-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" acquired by "delete_volume" :: waited 0.038s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[815c86ec-c77f-40f3-b3ba-1e1da9ff9067]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 0.399s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:17 devstack quobyte-client[83978]: System call of process 88514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 1 in 0.504s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" returned: 0 in 0.106s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa" released by "delete_volume" :: held 1.287s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Created reservations ['edf2c867-7748-436a-97d2-c132f3452f2a', '360422cf-ec93-44b8-93cf-c827d363ecb3', '38813944-9652-4c92-b94e-c36e5686cdfb', '313faa4a-4c30-4e3a-9cac-3c3a7121f5ec'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.306s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:18 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:38:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Deleted volume successfully.
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c6f1c8be-1e66-4d3b-ad52-15e221c8c0c3 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-c5e7edbb-47a1-4897-a7d7-5d214cf97bfa-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Flow 'volume_create_manager' (50ae6cb3-cf6d-4977-8d73-42203fcfec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df3c21-ab00-41e2-bc0d-7c2be62badbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df3c21-ab00-41e2-bc0d-7c2be62badbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1180077396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75989ec-3f56-44d8-bac2-d1f8c78c24f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d0d1723a2428bbaea758b80ae2dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:38:19Z,use_quota=True,user_id='35c6893cde2e4702b0b7df849a6f03d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb56dc4c-2e6f-4b9e-9dfd-558051c63518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb56dc4c-2e6f-4b9e-9dfd-558051c63518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91df9aa4-c64f-4694-9797-c227ae4ebe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91df9aa4-c64f-4694-9797-c227ae4ebe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75989ec-3f56-44d8-bac2-d1f8c78c24f9', 'volume_name': 'volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab9bfeb-963c-401a-9d91-24566f323af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab9bfeb-963c-401a-9d91-24566f323af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c79310-1101-405c-ae3e-d1e3f1061bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:19 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Volume f75989ec-3f56-44d8-bac2-d1f8c78c24f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9', 'volume_size': 1}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1180077396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75989ec-3f56-44d8-bac2-d1f8c78c24f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d0d1723a2428bbaea758b80ae2dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:38:19Z,use_quota=True,user_id='35c6893cde2e4702b0b7df849a6f03d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Creating volume f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:38:19 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:38:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:20 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=34, name=volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 1073741824" returned: 0 in 0.496s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 0.150s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c79310-1101-405c-ae3e-d1e3f1061bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5283c6-a557-48dc-8f2a-12e80e3469ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Volume volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 (f75989ec-3f56-44d8-bac2-d1f8c78c24f9): created successfully
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5283c6-a557-48dc-8f2a-12e80e3469ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Flow 'volume_create_manager' (50ae6cb3-cf6d-4977-8d73-42203fcfec7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:38:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ceba565a-498f-4c15-8b8a-789a0f4d741d tempest-VolumesExtendTest-1161210201 None] Created volume successfully.
Sep 25 19:38:22 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Creating offline snapshot ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc of volume f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b476690-40ae-457e-ab80-b233a8685671]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:22 devstack quobyte-client[83978]: System call of process 88573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 0.533s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:22 devstack quobyte-client[83978]: System call of process 88578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:23 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=35, name=volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc 1G" returned: 0 in 0.361s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img rebase -u -b volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 0.210s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 0.128s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 0.130s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.info" returned: 0 in 0.115s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:38:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.info" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d5823c22-bffc-463d-adca-ee4d6e8010dd tempest-VolumesExtendTest-1161210201 None] Create snapshot completed successfully
Sep 25 19:38:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:25 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed4836-cafd-485c-9199-8aba647b6c04]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:26 devstack quobyte-client[83978]: System call of process 88597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 0.604s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc 2G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:26 devstack quobyte-client[83978]: System call of process 88602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:26 devstack quobyte-client[83978]: System call of process 88602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:26 devstack quobyte-client[83978]: System call of process 88602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc 2G" returned: 0 in 0.479s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.289s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:27 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9ca31e44-6006-4189-899b-cdd498aa73c9 tempest-VolumesExtendTest-1161210201 None] Extend volume completed successfully.
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.155s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:28 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-quobyte-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Deleting offline snapshot ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc of volume f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] snapshot_file for this snap is: volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d8ca0-db9c-470d-9b6e-f2a92ae8c4c0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:29 devstack quobyte-client[83978]: System call of process 88620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 1.034s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:38:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f6188c-af45-4e90-8ea7-a367af0cefb3]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 1.029s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:31 devstack quobyte-client[83978]: System call of process 88629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 0.315s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9.ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" returned: 0 in 0.163s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc" released by "_delete_snapshot" :: held 3.068s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" released by "delete_snapshot" :: held 3.111s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:32 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Created reservations ['53b37836-110e-4001-9f31-6aeb1d040ad3', '0beaed32-a9ab-4dff-945d-f0774115b0e8', '80930f41-9491-4e9a-8d84-125dd64ffd50', '38f3e395-0011-4471-8b65-d1ad1f602376'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:38:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Delete snapshot completed successfully.
Sep 25 19:38:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c53bb27e-8ee3-455a-a450-1b490e795719 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-ce8fcc0d-aaa3-4267-a5a8-49f85e284cfc-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-f75989ec-3f56-44d8-bac2-d1f8c78c24f9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-f75989ec-3f56-44d8-bac2-d1f8c78c24f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1eaef-f4d5-48e7-adc8-4d5ceac13cb2]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 0.705s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" returned: 0 in 0.144s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-quobyte-f75989ec-3f56-44d8-bac2-d1f8c78c24f9" released by "delete_volume" :: held 1.115s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Created reservations ['28176aaf-218b-4bef-87ee-78aa7382921a', '4898677f-1d4e-42c7-9dca-ed1a1d5bd13d', '8a88fec7-aaf0-41ca-a2e8-e6f1bdffc9a1', '2d00b062-32a9-4a66-aef0-89dc43881c9b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:34 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:38:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Deleted volume successfully.
Sep 25 19:38:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c736520d-ddbc-454a-b631-e07363428323 tempest-VolumesExtendTest-1161210201 None] Lock "cinder-f75989ec-3f56-44d8-bac2-d1f8c78c24f9-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:38:40 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Flow 'volume_create_manager' (09129cee-6969-43f2-b240-03434f3faddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5dbf63-d02e-4c95-9ff1-fa43f83e70c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5dbf63-d02e-4c95-9ff1-fa43f83e70c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-695970143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c517466b-08f4-4cb7-8d90-42e7d2e4dd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8492d90065a4223a78706adfb054717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:38:41Z,use_quota=True,user_id='363fd7741731401abb98cfc7ca8b5b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89b53dd-e97e-4f2b-990f-36fd751481b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89b53dd-e97e-4f2b-990f-36fd751481b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19268b41-728c-4871-90fa-f0517f5081a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19268b41-728c-4871-90fa-f0517f5081a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c517466b-08f4-4cb7-8d90-42e7d2e4dd8f', 'volume_name': 'volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac4abbf-864c-4477-8a4b-1a056d01002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac4abbf-864c-4477-8a4b-1a056d01002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af84fb9-9da9-4d03-b8a5-69fd0220788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:40 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Volume c517466b-08f4-4cb7-8d90-42e7d2e4dd8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f', 'volume_size': 1}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-695970143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c517466b-08f4-4cb7-8d90-42e7d2e4dd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8492d90065a4223a78706adfb054717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:38:41Z,use_quota=True,user_id='363fd7741731401abb98cfc7ca8b5b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Creating volume c517466b-08f4-4cb7-8d90-42e7d2e4dd8f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:38:40 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:38:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:41 devstack quobyte-client[83978]: System call of process 88647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:38:41 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=37, name=volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f 1073741824" returned: 0 in 0.450s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af84fb9-9da9-4d03-b8a5-69fd0220788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b59c9d-a549-4291-99e3-0019416e8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:38:41 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Volume volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f (c517466b-08f4-4cb7-8d90-42e7d2e4dd8f): created successfully
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b59c9d-a549-4291-99e3-0019416e8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:38:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Flow 'volume_create_manager' (09129cee-6969-43f2-b240-03434f3faddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:38:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-81ec82fd-dc64-48ff-895e-da85ad82f05a tempest-VolumesNegativeTest-562267632 None] Created volume successfully.
Sep 25 19:38:51 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:INSERT=17,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:38:51 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=29,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:38:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:38:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.123s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:38:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:39:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-11dbf84b-6abd-483a-9a6d-f72b47f1b99f req-2578a228-62dd-448d-9f43-1aa9dc755e7d tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:39:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-11dbf84b-6abd-483a-9a6d-f72b47f1b99f req-2578a228-62dd-448d-9f43-1aa9dc755e7d tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:39:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-11dbf84b-6abd-483a-9a6d-f72b47f1b99f req-2578a228-62dd-448d-9f43-1aa9dc755e7d tempest-AttachVolumeTestJSON-1604430487 None] Terminate volume connection completed successfully.
Sep 25 19:39:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-11dbf84b-6abd-483a-9a6d-f72b47f1b99f req-2578a228-62dd-448d-9f43-1aa9dc755e7d tempest-AttachVolumeTestJSON-1604430487 None] Deleting attachment b679199a-04a3-428a-9637-5d68f9beb438. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:39:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:39:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:39:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:39:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:39:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e280918-7f02-40ec-9cc3-f3a00c8002d2]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:39:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:39:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5" returned: 0 in 0.945s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:39:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.120s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:39:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-6e49ea16-5706-40d6-9d0d-10043b2370a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f92b512-8608-4e7b-8478-b0b9bd7a9b81', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:39:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:39:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-f9b716be-9c76-4465-a3ba-c457c2f8fb7e req-be078ec0-3cf3-4c16-8299-db66902a0b61 tempest-TaggedAttachmentsTest-2095767279 None] attachment_update completed successfully.
Sep 25 19:39:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Acquiring lock "cinder-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:39:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "cinder-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:39:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:39:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Acquiring lock "cinder-quobyte-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:39:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "cinder-quobyte-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" acquired by "delete_volume" :: waited 0.036s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:39:30 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d53472-ad66-473f-bb45-7f2a7b0d86ed]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:39:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:39:31 devstack quobyte-client[83978]: System call of process 89475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:39:31 devstack quobyte-client[83978]: System call of process 89475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:39:31 devstack quobyte-client[83978]: System call of process 89475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:39:31 devstack quobyte-client[83978]: System call of process 89475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:39:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" returned: 0 in 1.613s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:39:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:39:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" returned: 0 in 0.263s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:39:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "cinder-quobyte-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f" released by "delete_volume" :: held 2.225s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Created reservations ['ae6b102d-bb96-42d7-b7af-5d18a98370f4', '6d636b8b-7b1e-427c-85ba-e5d2b245db3b', 'a559f63d-b165-4b53-89ce-58ac8dcf5e33', 'a3cefa74-6970-4f33-b5b6-fd4443e0c648'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.311s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:39:33 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:39:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Deleted volume successfully.
Sep 25 19:39:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bec47b4e-1500-4e51-a5f1-82ee3aa53468 tempest-VolumesNegativeTest-562267632 None] Lock "cinder-c517466b-08f4-4cb7-8d90-42e7d2e4dd8f-delete_volume" released by "delete_volume" :: held 4.414s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:39:43 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:39:44 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:39:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:39:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.184s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:39:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:40:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-73910323-5d0c-426e-9506-16a0f352528b req-491c87cd-a7f0-4e57-a17a-c8f4cdecea1a tempest-TaggedAttachmentsTest-2095767279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:40:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-73910323-5d0c-426e-9506-16a0f352528b req-491c87cd-a7f0-4e57-a17a-c8f4cdecea1a tempest-TaggedAttachmentsTest-2095767279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:40:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-73910323-5d0c-426e-9506-16a0f352528b req-491c87cd-a7f0-4e57-a17a-c8f4cdecea1a tempest-TaggedAttachmentsTest-2095767279 None] Terminate volume connection completed successfully.
Sep 25 19:40:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-73910323-5d0c-426e-9506-16a0f352528b req-491c87cd-a7f0-4e57-a17a-c8f4cdecea1a tempest-TaggedAttachmentsTest-2095767279 None] Deleting attachment 2f92b512-8608-4e7b-8478-b0b9bd7a9b81. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:40:10 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:40:10 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:40:43 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Flow 'volume_create_manager' (a579c456-33bd-4a9c-b575-542534f82c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f9f172-41d8-4a18-883b-777bafa1ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f9f172-41d8-4a18-883b-777bafa1ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1279977075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cb5c2-82e9-4929-a0a2-649760bd0101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11f261aa77c4ccb8bf223be799d348d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:40:43Z,use_quota=True,user_id='90b2b79348ae4d07a5b54f8306284e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86c8680-a952-420a-a69e-0b53a29aeead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86c8680-a952-420a-a69e-0b53a29aeead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7347726-091d-4482-a3b8-84975bca0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7347726-091d-4482-a3b8-84975bca0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947cb5c2-82e9-4929-a0a2-649760bd0101', 'volume_name': 'volume-947cb5c2-82e9-4929-a0a2-649760bd0101', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e5ac9e-3d47-4963-b9c8-86213742f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e5ac9e-3d47-4963-b9c8-86213742f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881019bc-0e70-43eb-af9c-3c37c4e19c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:43 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Volume 947cb5c2-82e9-4929-a0a2-649760bd0101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947cb5c2-82e9-4929-a0a2-649760bd0101', 'volume_size': 1}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1279977075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cb5c2-82e9-4929-a0a2-649760bd0101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11f261aa77c4ccb8bf223be799d348d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:40:43Z,use_quota=True,user_id='90b2b79348ae4d07a5b54f8306284e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Creating volume 947cb5c2-82e9-4929-a0a2-649760bd0101 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:40:43 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:40:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:43 devstack quobyte-client[83978]: System call of process 89847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:43 devstack quobyte-client[83978]: System call of process 89847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:43 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=38, name=volume-947cb5c2-82e9-4929-a0a2-649760bd0101, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:40:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 1073741824" returned: 0 in 1.021s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101" returned: 0 in 0.402s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] <== create_volume: return (1647ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:40:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:40:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881019bc-0e70-43eb-af9c-3c37c4e19c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947cb5c2-82e9-4929-a0a2-649760bd0101', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7fb250-7b11-4f40-bd31-89f07fbf4734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:40:46 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Volume volume-947cb5c2-82e9-4929-a0a2-649760bd0101 (947cb5c2-82e9-4929-a0a2-649760bd0101): created successfully
Sep 25 19:40:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7fb250-7b11-4f40-bd31-89f07fbf4734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:40:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Flow 'volume_create_manager' (a579c456-33bd-4a9c-b575-542534f82c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:40:46 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-2567ae6c-da67-4c97-8c18-50f83a6c0669 tempest-TestMinimumBasicScenario-766589920 None] Created volume successfully.
Sep 25 19:40:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:40:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:40:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea907ce-3d3c-4d40-aeff-1a94826dfdee]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:40:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:53 devstack quobyte-client[83978]: System call of process 89910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:53 devstack quobyte-client[83978]: System call of process 89910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101" returned: 0 in 0.852s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.728s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:40:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-947cb5c2-82e9-4929-a0a2-649760bd0101', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b8ac523-da71-4cfc-8f67-9fb3a88ca465', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:40:54 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "cinder-6e49ea16-5706-40d6-9d0d-10043b2370a5-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:40:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-9b7ce48e-72ef-4bd0-be98-56441adb2ae8 req-5c22981e-1f5e-4439-abb7-5e409e118150 tempest-TestMinimumBasicScenario-766589920 None] attachment_update completed successfully.
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "cinder-6e49ea16-5706-40d6-9d0d-10043b2370a5-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:40:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "cinder-quobyte-6e49ea16-5706-40d6-9d0d-10043b2370a5" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "cinder-quobyte-6e49ea16-5706-40d6-9d0d-10043b2370a5" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63ad71-a0b3-42de-9a41-e6eb44b26907]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:40:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:56 devstack quobyte-client[83978]: System call of process 89916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:56 devstack quobyte-client[83978]: System call of process 89916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:56 devstack quobyte-client[83978]: System call of process 89916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:56 devstack quobyte-client[83978]: System call of process 89916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:40:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5" returned: 0 in 1.013s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6e49ea16-5706-40d6-9d0d-10043b2370a5" returned: 0 in 0.379s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "cinder-quobyte-6e49ea16-5706-40d6-9d0d-10043b2370a5" released by "delete_volume" :: held 1.784s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:40:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Created reservations ['ba3b9851-a9ee-495c-b537-54e5c69ec61e', '4b8d7e52-e66b-42c3-9c8f-5544bf5f5f78', '5ab65c88-6100-476b-9017-61a0a6001504', '577d15ca-db0b-4666-8c46-d5cc7c1127a7'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.081s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.244s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:40:58 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:40:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Deleted volume successfully.
Sep 25 19:40:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0e696353-b134-4606-bfc8-f34c29616908 tempest-TaggedAttachmentsTest-2095767279 None] Lock "cinder-6e49ea16-5706-40d6-9d0d-10043b2370a5-delete_volume" released by "delete_volume" :: held 3.908s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:41:07 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=13,cinder:SELECT=10 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:41:08 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:41:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:41:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.303s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:41:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:42:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:42:02 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (105ef0a6-bd30-4f4a-bc15-fe35f5099727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2e531-55cc-4e4d-af1e-a8f113877f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f2e531-55cc-4e4d-af1e-a8f113877f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-760936379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc859e41-8b7e-4860-a519-e7b1a120246d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:02Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76bf3ec-880a-4833-b24d-57e9ebab2308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76bf3ec-880a-4833-b24d-57e9ebab2308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276df396-ad5b-41e2-a135-b0a9a23d51fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:03 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 19:42:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276df396-ad5b-41e2-a135-b0a9a23d51fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc859e41-8b7e-4860-a519-e7b1a120246d', 'volume_name': 'volume-fc859e41-8b7e-4860-a519-e7b1a120246d', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790c385b0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305d4e20-93b5-4e52-8bc9-e57257bd0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305d4e20-93b5-4e52-8bc9-e57257bd0d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de258797-84f5-4c8f-8070-f5722041ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:04 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Volume fc859e41-8b7e-4860-a519-e7b1a120246d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc859e41-8b7e-4860-a519-e7b1a120246d', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790c385b0>}
Sep 25 19:42:04 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Cloning fc859e41-8b7e-4860-a519-e7b1a120246d from image 926ecad1-382a-474f-abd8-fe37d592162a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 19:42:05 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 19:42:05 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 19:42:05 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d6270c-2546-4fef-93fa-3727dbdc324b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:06 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD
Sep 25 19:42:06 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:42:11 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Sep 25 19:42:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD" returned: 0 in 5.283s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:11 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a is fetched for user e8653c13bac04a28ba8523cc6873c98b. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 19:42:11 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ebbf1-8d01-49e9-b882-03c4b4aaf250]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:12 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD
Sep 25 19:42:12 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:42:13 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Sep 25 19:42:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD" returned: 0 in 2.342s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-760936379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc859e41-8b7e-4860-a519-e7b1a120246d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:02Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Creating volume fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:42:14 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:14 devstack quobyte-client[83978]: System call of process 90721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:14 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=39, name=volume-fc859e41-8b7e-4860-a519-e7b1a120246d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d 1073741824" returned: 0 in 0.379s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 0.106s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] <== create_volume: return (580ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.623s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Attempting download of 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume fc859e41-8b7e-4860-a519-e7b1a120246d. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd4932-7eff-490e-9428-d5f14e671f4a]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_y840rqvx {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_y840rqvx" returned: 0 in 0.458s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_y840rqvx {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_y840rqvx" returned: 1 in 0.393s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_y840rqvx' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e45a0-aa1d-4a8b-becf-20d0465d7889]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:16 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] 926ecad1-382a-474f-abd8-fe37d592162a was qcow2, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 19:42:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:16 devstack quobyte-client[83978]: System call of process 90733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:16 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=39, name=volume-fc859e41-8b7e-4860-a519-e7b1a120246d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:42:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 1.632s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:17 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_g9ek1tj5devstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 19:42:17 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Converted 112.00 MB image at 67.25 MB/s
Sep 25 19:42:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:18 devstack quobyte-client[83978]: System call of process 90768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:18 devstack quobyte-client[83978]: System call of process 90768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:18 devstack quobyte-client[83978]: System call of process 90768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d 1G" returned: 0 in 0.265s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:18 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9762b8f-fa81-4d6b-9301-9ba2cb3593af]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 0.618s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 1 in 0.445s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Downloaded image 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume fc859e41-8b7e-4860-a519-e7b1a120246d successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a for user e8653c13bac04a28ba8523cc6873c98b is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 19:42:19 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Marking volume fc859e41-8b7e-4860-a519-e7b1a120246d as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Copying metadata from image 926ecad1-382a-474f-abd8-fe37d592162a to fc859e41-8b7e-4860-a519-e7b1a120246d. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Creating volume glance metadata for volume fc859e41-8b7e-4860-a519-e7b1a120246d backed by image 926ecad1-382a-474f-abd8-fe37d592162a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de258797-84f5-4c8f-8070-f5722041ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc859e41-8b7e-4860-a519-e7b1a120246d', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790c385b0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5936436-0f63-4565-856d-2106aadcf455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Volume volume-fc859e41-8b7e-4860-a519-e7b1a120246d (fc859e41-8b7e-4860-a519-e7b1a120246d): created successfully
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5936436-0f63-4565-856d-2106aadcf455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (105ef0a6-bd30-4f4a-bc15-fe35f5099727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a65c9ca6-8ba2-4802-b1f5-66d2ab10a11e tempest-TaggedBootDevicesTest-534282896 None] Created volume successfully.
Sep 25 19:42:22 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (6b4c6489-06b1-40fe-857e-f96118136829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0331fc-b836-47e7-a26b-bd82391e8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0331fc-b836-47e7-a26b-bd82391e8207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-922787915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328123f7-6bce-4016-a94c-9b8cd582df7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:22Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fcd718-6c67-407f-8862-593b77be7985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fcd718-6c67-407f-8862-593b77be7985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ad3395-616e-42b0-a382-c9862a6fccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ad3395-616e-42b0-a382-c9862a6fccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328123f7-6bce-4016-a94c-9b8cd582df7b', 'volume_name': 'volume-328123f7-6bce-4016-a94c-9b8cd582df7b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803fe317-0f1a-4b00-98bd-78e8f2aa8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803fe317-0f1a-4b00-98bd-78e8f2aa8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78236246-bce2-4b54-8a35-e78733cb13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:22 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Volume 328123f7-6bce-4016-a94c-9b8cd582df7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328123f7-6bce-4016-a94c-9b8cd582df7b', 'volume_size': 1}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-922787915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328123f7-6bce-4016-a94c-9b8cd582df7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:22Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Creating volume 328123f7-6bce-4016-a94c-9b8cd582df7b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:42:22 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:22 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=40, name=volume-328123f7-6bce-4016-a94c-9b8cd582df7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b 1073741824" returned: 0 in 0.407s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b" returned: 0 in 0.096s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] <== create_volume: return (583ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:42:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.596s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78236246-bce2-4b54-8a35-e78733cb13e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328123f7-6bce-4016-a94c-9b8cd582df7b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e0d78a-0fc9-449b-9631-cc950ffed5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:23 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Volume volume-328123f7-6bce-4016-a94c-9b8cd582df7b (328123f7-6bce-4016-a94c-9b8cd582df7b): created successfully
Sep 25 19:42:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e0d78a-0fc9-449b-9631-cc950ffed5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (6b4c6489-06b1-40fe-857e-f96118136829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:23 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cba47dd8-facf-4f1b-9141-e9c4c5928e5f tempest-TaggedBootDevicesTest-534282896 None] Created volume successfully.
Sep 25 19:42:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (9bac23fc-b1a2-4673-adfa-9786b73bac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c432880a-a525-4c5c-b152-2d2882f34612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c432880a-a525-4c5c-b152-2d2882f34612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1040662375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea186ba7-146a-4e99-bf68-ed83ee9a5765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:24Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed579be2-469c-4434-bd85-0288ff239c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed579be2-469c-4434-bd85-0288ff239c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd0b05-5c6a-4154-bbf5-d69581c420ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd0b05-5c6a-4154-bbf5-d69581c420ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea186ba7-146a-4e99-bf68-ed83ee9a5765', 'volume_name': 'volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602bf857-a35b-44df-a8f6-cc23dcc705fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602bf857-a35b-44df-a8f6-cc23dcc705fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49545e34-e9ae-4b23-9b20-5653c1640a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:24 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Volume ea186ba7-146a-4e99-bf68-ed83ee9a5765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765', 'volume_size': 1}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1040662375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea186ba7-146a-4e99-bf68-ed83ee9a5765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e49862eccd4090aaf1307030b3dc86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:24Z,use_quota=True,user_id='e8653c13bac04a28ba8523cc6873c98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Creating volume ea186ba7-146a-4e99-bf68-ed83ee9a5765 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:42:24 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:42:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:24 devstack quobyte-client[83978]: System call of process 90783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:24 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=41, name=volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 1073741824" returned: 0 in 0.391s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] <== create_volume: return (565ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49545e34-e9ae-4b23-9b20-5653c1640a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534675a-0548-4583-9f31-9c6e566c9ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:25 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Volume volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 (ea186ba7-146a-4e99-bf68-ed83ee9a5765): created successfully
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534675a-0548-4583-9f31-9c6e566c9ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Flow 'volume_create_manager' (9bac23fc-b1a2-4673-adfa-9786b73bac82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b1e398c7-1cfe-4fb5-adfb-eccbec82673a tempest-TaggedBootDevicesTest-534282896 None] Created volume successfully.
Sep 25 19:42:35 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:42:35 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=8,cinder:SELECT=13,cinder:INSERT=13,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:52 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (81232247-4553-4b37-bd3d-f9c67dfecd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30842790-c95f-4350-9fa7-79d27a32a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315ed87-06a5-42d7-b0d6-668a0a380b5a]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30842790-c95f-4350-9fa7-79d27a32a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014308767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee330a49-32d9-449d-90d6-6651eb4b276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:52Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccfe6a5-60d7-4ab8-9b0b-d96a6c0c9b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccfe6a5-60d7-4ab8-9b0b-d96a6c0c9b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c19fdf0-a5d1-4d39-ac02-a2a2abc3822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c19fdf0-a5d1-4d39-ac02-a2a2abc3822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee330a49-32d9-449d-90d6-6651eb4b276d', 'volume_name': 'volume-ee330a49-32d9-449d-90d6-6651eb4b276d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37b1749-67ff-42cf-8b79-0b1de758ed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37b1749-67ff-42cf-8b79-0b1de758ed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610fd6bb-1959-4cba-be2e-f1ab39b510dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:52 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Volume ee330a49-32d9-449d-90d6-6651eb4b276d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee330a49-32d9-449d-90d6-6651eb4b276d', 'volume_size': 1}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:53 devstack quobyte-client[83978]: System call of process 90849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 0.799s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:53 devstack quobyte-client[83978]: System call of process 90852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 1 in 0.420s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:42:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.551s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014308767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee330a49-32d9-449d-90d6-6651eb4b276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:42:52Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Creating volume ee330a49-32d9-449d-90d6-6651eb4b276d {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:42:54 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:54 devstack quobyte-client[83978]: System call of process 90855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:54 devstack quobyte-client[83978]: System call of process 90855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:54 devstack quobyte-client[83978]: System call of process 90855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:42:54 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=42, name=volume-ee330a49-32d9-449d-90d6-6651eb4b276d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d 1073741824" returned: 0 in 0.571s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.634s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d" returned: 0 in 0.296s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] <== create_volume: return (913ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-fc859e41-8b7e-4860-a519-e7b1a120246d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67fa3b8b-9b27-4587-9ab7-48566c90e957', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:42:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610fd6bb-1959-4cba-be2e-f1ab39b510dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee330a49-32d9-449d-90d6-6651eb4b276d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff09243-6275-432b-8687-36998bea8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:42:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Volume volume-ee330a49-32d9-449d-90d6-6651eb4b276d (ee330a49-32d9-449d-90d6-6651eb4b276d): created successfully
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff09243-6275-432b-8687-36998bea8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:42:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (81232247-4553-4b37-bd3d-f9c67dfecd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:42:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-02b64966-a9d3-429d-8e54-248ab0a73093 tempest-TaggedBootDevicesTest-534282896 None] attachment_update completed successfully.
Sep 25 19:42:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-156a62a8-6545-4a37-bbcf-23c45e73cce8 tempest-AttachVolumeTestJSON-1604430487 None] Created volume successfully.
Sep 25 19:42:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:42:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:42:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[058bb621-3ae9-4214-922b-26d7d20386da]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:42:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:42:59 devstack quobyte-client[83978]: System call of process 90871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b" returned: 0 in 1.070s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.184s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-328123f7-6bce-4016-a94c-9b8cd582df7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93a49f35-c99f-4209-bd18-22bf1d038995', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:43:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-eaba6ba9-9b11-424b-965b-2f4d17491f60 tempest-TaggedBootDevicesTest-534282896 None] attachment_update completed successfully.
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f714986-5cdf-49b8-a421-5f7368d52ee8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:43:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:01 devstack quobyte-client[83978]: System call of process 90888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:01 devstack quobyte-client[83978]: System call of process 90888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:01 devstack quobyte-client[83978]: System call of process 90888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:01 devstack quobyte-client[83978]: System call of process 90888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d" returned: 0 in 0.656s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ee330a49-32d9-449d-90d6-6651eb4b276d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3613a76-9882-492e-a4e0-ab93e7b065e1', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:43:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-0ffd37d1-17df-468a-ab20-9ad9f6bbf0b9 req-eef5f131-4d68-465b-ac0c-26c8bb6fbc29 tempest-AttachVolumeTestJSON-1604430487 None] attachment_update completed successfully.
Sep 25 19:43:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:03 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[db57cb10-ec47-4f55-b44e-e14c317267ec]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:43:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:04 devstack quobyte-client[83978]: System call of process 90910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:04 devstack quobyte-client[83978]: System call of process 90910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:04 devstack quobyte-client[83978]: System call of process 90910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765" returned: 0 in 1.300s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.450s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5135356-2241-47ca-a3ac-0d21152a45de', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:43:05 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-2e194982-2b6b-4c3b-9c0d-e09ad38b93f0 req-ffb57131-f440-4305-afcb-d88863ef6ba1 tempest-TaggedBootDevicesTest-534282896 None] attachment_update completed successfully.
Sep 25 19:43:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (e25c5ad5-8050-493d-9001-2594def95061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4c582f-a5d0-4a9e-93a6-f5005ed49159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4c582f-a5d0-4a9e-93a6-f5005ed49159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1816901929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5629ace1-ad53-4fd0-adb8-9f1725c09631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:43:10Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20434fc6-cc90-4a24-9e5b-391d21af6b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20434fc6-cc90-4a24-9e5b-391d21af6b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8225a5f-63ce-4d92-be0f-6f7d091ee255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8225a5f-63ce-4d92-be0f-6f7d091ee255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5629ace1-ad53-4fd0-adb8-9f1725c09631', 'volume_name': 'volume-5629ace1-ad53-4fd0-adb8-9f1725c09631', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a504a-98c2-4018-9843-fa0a42f2cb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a504a-98c2-4018-9843-fa0a42f2cb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941392fd-b34d-4d1f-ad8f-e9650b6d7505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:10 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Volume 5629ace1-ad53-4fd0-adb8-9f1725c09631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5629ace1-ad53-4fd0-adb8-9f1725c09631', 'volume_size': 1}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1816901929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5629ace1-ad53-4fd0-adb8-9f1725c09631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769d58df40dd47cdae878ae97b3a0095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:43:10Z,use_quota=True,user_id='5f651c84e3a040d2ba114dbcae32424d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Creating volume 5629ace1-ad53-4fd0-adb8-9f1725c09631 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:43:10 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:43:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:11 devstack quobyte-client[83978]: System call of process 90925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:11 devstack quobyte-client[83978]: System call of process 90925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:11 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=43, name=volume-5629ace1-ad53-4fd0-adb8-9f1725c09631, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:43:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 1073741824" returned: 0 in 0.608s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631" returned: 0 in 0.139s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] <== create_volume: return (856ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:43:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941392fd-b34d-4d1f-ad8f-e9650b6d7505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5629ace1-ad53-4fd0-adb8-9f1725c09631', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3e2d2-44d2-4478-9183-8f69ac1eddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:43:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Volume volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 (5629ace1-ad53-4fd0-adb8-9f1725c09631): created successfully
Sep 25 19:43:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3e2d2-44d2-4478-9183-8f69ac1eddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:43:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Flow 'volume_create_manager' (e25c5ad5-8050-493d-9001-2594def95061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:43:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-99f70bda-c304-4790-a802-fe9ab1e85d40 tempest-AttachVolumeTestJSON-1604430487 None] Created volume successfully.
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b4ed44-63cf-4c74-913f-f0776b31afc0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:17 devstack quobyte-client[83978]: System call of process 90945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631" returned: 0 in 0.700s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-5629ace1-ad53-4fd0-adb8-9f1725c09631', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09a6fec8-eef9-49a2-9465-070088a96408', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:43:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-c95760b0-229e-4feb-b760-db4101d2e43c req-117c4099-8cc1-4058-8b86-236e19a8369d tempest-AttachVolumeTestJSON-1604430487 None] attachment_update completed successfully.
Sep 25 19:43:28 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:43:28 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=33,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:43:40 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:43:40 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:43:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-45cbd3fa-eed3-40ae-a5d8-837be3c17be6 req-05d835bc-db10-481d-a7b9-03bbf37dc72a tempest-TestMinimumBasicScenario-766589920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-45cbd3fa-eed3-40ae-a5d8-837be3c17be6 req-05d835bc-db10-481d-a7b9-03bbf37dc72a tempest-TestMinimumBasicScenario-766589920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-45cbd3fa-eed3-40ae-a5d8-837be3c17be6 req-05d835bc-db10-481d-a7b9-03bbf37dc72a tempest-TestMinimumBasicScenario-766589920 None] Terminate volume connection completed successfully.
Sep 25 19:43:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-45cbd3fa-eed3-40ae-a5d8-837be3c17be6 req-05d835bc-db10-481d-a7b9-03bbf37dc72a tempest-TestMinimumBasicScenario-766589920 None] Deleting attachment 7b8ac523-da71-4cfc-8f67-9fb3a88ca465. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "cinder-947cb5c2-82e9-4929-a0a2-649760bd0101-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "cinder-947cb5c2-82e9-4929-a0a2-649760bd0101-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:43:43 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "cinder-quobyte-947cb5c2-82e9-4929-a0a2-649760bd0101" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "cinder-quobyte-947cb5c2-82e9-4929-a0a2-649760bd0101" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d38c4-4098-4ec8-8e9b-ce8e8d829422]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:43:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:43 devstack quobyte-client[83978]: System call of process 91423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101" returned: 0 in 0.836s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-947cb5c2-82e9-4929-a0a2-649760bd0101" returned: 0 in 0.185s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "cinder-quobyte-947cb5c2-82e9-4929-a0a2-649760bd0101" released by "delete_volume" :: held 1.247s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Created reservations ['b1192175-aa50-4eac-b2b1-394f4eea1fca', 'd94dd097-ee36-4b14-8fdd-307db40fb517', 'b5e11004-a883-4f65-8e5f-89da7f47c115', 'fcd8fd30-b859-4fad-b07f-dc4e8424ab07'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:43:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:43:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.257s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:45 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:43:46 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Deleted volume successfully.
Sep 25 19:43:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6bcc60fa-5ca5-47b2-a841-08ce8c5b736f tempest-TestMinimumBasicScenario-766589920 None] Lock "cinder-947cb5c2-82e9-4929-a0a2-649760bd0101-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:43:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-895af70a-498b-4aa3-afbd-1bdff561a1c4 req-7bb22abb-98e4-4c81-81a1-b3f300d2ca0c tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-895af70a-498b-4aa3-afbd-1bdff561a1c4 req-7bb22abb-98e4-4c81-81a1-b3f300d2ca0c tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:43:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-895af70a-498b-4aa3-afbd-1bdff561a1c4 req-7bb22abb-98e4-4c81-81a1-b3f300d2ca0c tempest-AttachVolumeTestJSON-1604430487 None] Terminate volume connection completed successfully.
Sep 25 19:43:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-895af70a-498b-4aa3-afbd-1bdff561a1c4 req-7bb22abb-98e4-4c81-81a1-b3f300d2ca0c tempest-AttachVolumeTestJSON-1604430487 None] Deleting attachment f3613a76-9882-492e-a4e0-ab93e7b065e1. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.295s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:43:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:43:58 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:43:58 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:44:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-bdbd85b9-d372-4d65-9d6a-ac46093fac47 req-8478be1e-a934-4919-9bf7-ad04a2681022 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:44:14 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-bdbd85b9-d372-4d65-9d6a-ac46093fac47 req-8478be1e-a934-4919-9bf7-ad04a2681022 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:44:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-bdbd85b9-d372-4d65-9d6a-ac46093fac47 req-8478be1e-a934-4919-9bf7-ad04a2681022 tempest-AttachVolumeTestJSON-1604430487 None] Terminate volume connection completed successfully.
Sep 25 19:44:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-bdbd85b9-d372-4d65-9d6a-ac46093fac47 req-8478be1e-a934-4919-9bf7-ad04a2681022 tempest-AttachVolumeTestJSON-1604430487 None] Deleting attachment 09a6fec8-eef9-49a2-9465-070088a96408. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:44:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-5629ace1-ad53-4fd0-adb8-9f1725c09631-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-5629ace1-ad53-4fd0-adb8-9f1725c09631-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-quobyte-5629ace1-ad53-4fd0-adb8-9f1725c09631" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-5629ace1-ad53-4fd0-adb8-9f1725c09631" acquired by "delete_volume" :: waited 0.053s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d972ee3e-25ea-4a18-aed0-f5e20b5a19ab]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:44:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:30 devstack quobyte-client[83978]: System call of process 91698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:30 devstack quobyte-client[83978]: System call of process 91698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:30 devstack quobyte-client[83978]: System call of process 91698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:30 devstack quobyte-client[83978]: System call of process 91698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631" returned: 0 in 1.276s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5629ace1-ad53-4fd0-adb8-9f1725c09631" returned: 0 in 0.201s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-5629ace1-ad53-4fd0-adb8-9f1725c09631" released by "delete_volume" :: held 2.106s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Created reservations ['452f9541-dc83-4e7c-8229-9f8e21c2e256', 'e8fccab3-1b7d-4b85-b154-cb62c831fdae', 'd66657f6-db09-4986-9e5e-b1585203f345', 'ddf88c4c-5d63-4ddd-b830-6e276209b214'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.184s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:32 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:44:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Deleted volume successfully.
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-ee330a49-32d9-449d-90d6-6651eb4b276d-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cf3ef1f6-a26b-4d5a-a5cb-b370e3b25416 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-5629ace1-ad53-4fd0-adb8-9f1725c09631-delete_volume" released by "delete_volume" :: held 4.116s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-ee330a49-32d9-449d-90d6-6651eb4b276d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-quobyte-ee330a49-32d9-449d-90d6-6651eb4b276d" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-ee330a49-32d9-449d-90d6-6651eb4b276d" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[561fad06-e457-4ccf-967e-2f1f32e12c7e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:44:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d" returned: 0 in 0.813s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee330a49-32d9-449d-90d6-6651eb4b276d" returned: 0 in 0.143s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-ee330a49-32d9-449d-90d6-6651eb4b276d" released by "delete_volume" :: held 1.299s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Created reservations ['d7a8c55c-e4a4-4802-b7b7-d312e594aea6', '43cc705c-d8e3-453d-804a-b43c1e7a8bd5', 'cdce6ca1-8ed9-4532-82bf-936f369e1a4e', '33105fde-7f8a-4dda-8e4a-7121182a77e2'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.201s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:36 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:44:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Deleted volume successfully.
Sep 25 19:44:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cd07a818-2ec7-459b-8947-0ad59a8c3c73 tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-ee330a49-32d9-449d-90d6-6651eb4b276d-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-9eca52bf-98ff-4173-bccd-95ae7b36f7d3-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-9eca52bf-98ff-4173-bccd-95ae7b36f7d3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "cinder-quobyte-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" acquired by "delete_volume" :: waited 0.039s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[306d73f1-f1ff-4d18-88b8-bd043d6d0b53]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:44:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:38 devstack quobyte-client[83978]: System call of process 91710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:38 devstack quobyte-client[83978]: System call of process 91710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:38 devstack quobyte-client[83978]: System call of process 91710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:44:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" returned: 0 in 0.956s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" returned: 0 in 0.165s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-quobyte-9eca52bf-98ff-4173-bccd-95ae7b36f7d3" released by "delete_volume" :: held 1.388s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Created reservations ['f56e4689-fe01-4292-8b56-c5e527f84c8f', 'a613badc-5f12-47b5-8e1a-995b5823f6e7', 'bacd13f1-0f80-4aea-8a79-a562fec048a4', '66b7ebaa-bd85-4e63-b937-738beecdffdb'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.225s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:44:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Deleted volume successfully.
Sep 25 19:44:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f0705ba-9780-4df2-8f57-663edc2d294f tempest-AttachVolumeTestJSON-1604430487 None] Lock "cinder-9eca52bf-98ff-4173-bccd-95ae7b36f7d3-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:44:49 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:44:49 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=28,cinder:SELECT=17,cinder:INSERT=11,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.182s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:44:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:45:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Flow 'volume_create_manager' (a3e1e139-6185-4d4e-96af-44b4e1880ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7accf943-7f81-43d5-95d8-66ec50024ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7accf943-7f81-43d5-95d8-66ec50024ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-826538411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f4486-0f2c-40eb-9719-785bcce4dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3465137eca43bb9a6519469e5afb51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:45:00Z,use_quota=True,user_id='033b4badd9294f3b9208fe04df8c3993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f73c-32f8-4270-ba24-f7a4d48dd3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f73c-32f8-4270-ba24-f7a4d48dd3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7f8076-11ca-4c9f-bfbd-c1e8fcece823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:00 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 19:45:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7f8076-11ca-4c9f-bfbd-c1e8fcece823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '798f4486-0f2c-40eb-9719-785bcce4dd7e', 'volume_name': 'volume-798f4486-0f2c-40eb-9719-785bcce4dd7e', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f979069c220>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3800d-0ef6-42e9-9302-10cf74cf2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3800d-0ef6-42e9-9302-10cf74cf2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aac25f-8f31-42a4-8f57-fc89ee2125fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:01 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Volume 798f4486-0f2c-40eb-9719-785bcce4dd7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-798f4486-0f2c-40eb-9719-785bcce4dd7e', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f979069c220>}
Sep 25 19:45:01 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Cloning 798f4486-0f2c-40eb-9719-785bcce4dd7e from image 926ecad1-382a-474f-abd8-fe37d592162a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 19:45:02 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 19:45:02 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 19:45:02 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea2641-2de5-48a4-a01a-92f24128dd6c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:03 devstack sudo[91730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD
Sep 25 19:45:03 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:45:05 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root
Sep 25 19:45:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD" returned: 0 in 2.895s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:05 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a is fetched for user 033b4badd9294f3b9208fe04df8c3993. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 19:45:05 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d11e92-c7f0-475f-9f4b-0e50d8ba50a7]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:06 devstack sudo[91736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD
Sep 25 19:45:06 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 19:45:08 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD" returned: 0 in 2.711s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-826538411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f4486-0f2c-40eb-9719-785bcce4dd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3465137eca43bb9a6519469e5afb51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:45:00Z,use_quota=True,user_id='033b4badd9294f3b9208fe04df8c3993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Creating volume 798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:45:08 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:08 devstack quobyte-client[83978]: System call of process 91741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:08 devstack quobyte-client[83978]: System call of process 91741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:08 devstack quobyte-client[83978]: System call of process 91741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:08 devstack quobyte-client[83978]: System call of process 91741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:08 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=44, name=volume-798f4486-0f2c-40eb-9719-785bcce4dd7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:45:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e 1073741824" returned: 0 in 0.396s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 0.127s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] <== create_volume: return (686ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Attempting download of 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume 798f4486-0f2c-40eb-9719-785bcce4dd7e. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f6c85-d819-4166-8aa9-ed946a8f5414]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dli__5xr {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dli__5xr" returned: 0 in 0.395s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dli__5xr {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dli__5xr" returned: 1 in 0.454s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ecad1-382a-474f-abd8-fe37d592162a_dli__5xr' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e8ad4e-e06b-48c1-8268-0fd555aa7896]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD" returned: 0 in 0.969s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:11 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] 926ecad1-382a-474f-abd8-fe37d592162a was qcow2, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 19:45:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:12 devstack quobyte-client[83978]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:12 devstack quobyte-client[83978]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:12 devstack quobyte-client[83978]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:12 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=44, name=volume-798f4486-0f2c-40eb-9719-785bcce4dd7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:45:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 1.764s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:13 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926ecad1-382a-474f-abd8-fe37d592162a_dj6kmibhdevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 19:45:13 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Converted 112.00 MB image at 61.55 MB/s
Sep 25 19:45:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:13 devstack quobyte-client[83978]: System call of process 91765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e 1G" returned: 0 in 0.267s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:14 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[57195e67-87d9-4685-b5b0-2d07aff8df20]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:15 devstack quobyte-client[83978]: System call of process 91768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 0.738s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:15 devstack quobyte-client[83978]: System call of process 91770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 1 in 0.902s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Downloaded image 926ecad1-382a-474f-abd8-fe37d592162a ((None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}])) to volume 798f4486-0f2c-40eb-9719-785bcce4dd7e successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Temporary image 926ecad1-382a-474f-abd8-fe37d592162a for user 033b4badd9294f3b9208fe04df8c3993 is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Marking volume 798f4486-0f2c-40eb-9719-785bcce4dd7e as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Copying metadata from image 926ecad1-382a-474f-abd8-fe37d592162a to 798f4486-0f2c-40eb-9719-785bcce4dd7e. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Creating volume glance metadata for volume 798f4486-0f2c-40eb-9719-785bcce4dd7e backed by image 926ecad1-382a-474f-abd8-fe37d592162a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aac25f-8f31-42a4-8f57-fc89ee2125fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798f4486-0f2c-40eb-9719-785bcce4dd7e', 'volume_size': 1, 'image_id': '926ecad1-382a-474f-abd8-fe37d592162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ecad1-382a-474f-abd8-fe37d592162a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5a3ccbabc6a24536b5ac16f601d96328', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '926ecad1-382a-474f-abd8-fe37d592162a', 'created_at': datetime.datetime(2025, 9, 25, 17, 23, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 17, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ecad1-382a-474f-abd8-fe37d592162a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f979069c220>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94593aa1-1d6d-4b4f-9ce6-4f95ba70d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:45:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Volume volume-798f4486-0f2c-40eb-9719-785bcce4dd7e (798f4486-0f2c-40eb-9719-785bcce4dd7e): created successfully
Sep 25 19:45:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94593aa1-1d6d-4b4f-9ce6-4f95ba70d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:45:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Flow 'volume_create_manager' (a3e1e139-6185-4d4e-96af-44b4e1880ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:45:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1bfc4ca5-eb08-4565-b76f-7c322c1348d1 tempest-TestShelveInstance-1584022448 None] Created volume successfully.
Sep 25 19:45:26 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:45:27 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=4,cinder:SELECT=13,cinder:INSERT=13,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:45:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:45:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:45:33 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4d8ed-165d-48ad-be58-633bff938e00]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:45:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:36 devstack quobyte-client[83978]: System call of process 92264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:36 devstack quobyte-client[83978]: System call of process 92264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:36 devstack quobyte-client[83978]: System call of process 92264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:36 devstack quobyte-client[83978]: System call of process 92264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 2.357s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:38 devstack quobyte-client[83978]: System call of process 92352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:45:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 1 in 2.030s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:45:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.931s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:45:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-798f4486-0f2c-40eb-9719-785bcce4dd7e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '536926e4-7ad9-44c4-898b-fc5a619a7e39', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:45:39 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:45:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-bf79af62-a854-4b17-ba97-9114064e27e0 req-f3936f84-06b3-4d1d-91a5-a7a6e05332dd tempest-TestShelveInstance-1584022448 None] attachment_update completed successfully.
Sep 25 19:45:50 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:45:50 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.091s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.351s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:45:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:46:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-c126b8df-0c30-4cb9-b85f-ad513d82adbf tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-c126b8df-0c30-4cb9-b85f-ad513d82adbf tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-c126b8df-0c30-4cb9-b85f-ad513d82adbf tempest-TaggedBootDevicesTest-534282896 None] Terminate volume connection completed successfully.
Sep 25 19:46:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-c126b8df-0c30-4cb9-b85f-ad513d82adbf tempest-TaggedBootDevicesTest-534282896 None] Deleting attachment 67fa3b8b-9b27-4587-9ab7-48566c90e957. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:46:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-859e5132-0983-4599-bfda-ebd766930e52 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-859e5132-0983-4599-bfda-ebd766930e52 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-859e5132-0983-4599-bfda-ebd766930e52 tempest-TaggedBootDevicesTest-534282896 None] Terminate volume connection completed successfully.
Sep 25 19:46:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-859e5132-0983-4599-bfda-ebd766930e52 tempest-TaggedBootDevicesTest-534282896 None] Deleting attachment 93a49f35-c99f-4209-bd18-22bf1d038995. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:46:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-7dc7b8ad-83da-4e9f-8c5e-00359e1cf7fa tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-7dc7b8ad-83da-4e9f-8c5e-00359e1cf7fa tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:03 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-7dc7b8ad-83da-4e9f-8c5e-00359e1cf7fa tempest-TaggedBootDevicesTest-534282896 None] Terminate volume connection completed successfully.
Sep 25 19:46:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-8f224c1b-ad25-42a0-a697-9e28221dd278 req-7dc7b8ad-83da-4e9f-8c5e-00359e1cf7fa tempest-TaggedBootDevicesTest-534282896 None] Deleting attachment e5135356-2241-47ca-a3ac-0d21152a45de. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:46:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:46:13 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-ea186ba7-146a-4e99-bf68-ed83ee9a5765-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-ea186ba7-146a-4e99-bf68-ed83ee9a5765-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-quobyte-ea186ba7-146a-4e99-bf68-ed83ee9a5765" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-ea186ba7-146a-4e99-bf68-ed83ee9a5765" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d701c5-c6f2-4d2b-bd7b-cdfebd6d7bfb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:15 devstack quobyte-client[83978]: System call of process 92961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:15 devstack quobyte-client[83978]: System call of process 92961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:15 devstack quobyte-client[83978]: System call of process 92961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765" returned: 0 in 0.434s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ea186ba7-146a-4e99-bf68-ed83ee9a5765" returned: 0 in 0.113s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-ea186ba7-146a-4e99-bf68-ed83ee9a5765" released by "delete_volume" :: held 0.710s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Created reservations ['fdc44857-34d6-4cb5-a090-7442a3b2651f', 'd59968c5-135a-40cb-a79a-0e2bfd024952', '2708a493-c22e-4de1-9f2c-d93b5c2bc45b', '2e322f99-3aee-4889-9903-5960cfb86ad5'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.243s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:17 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:46:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Deleted volume successfully.
Sep 25 19:46:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-796ca664-7dc8-4810-a774-da458d439819 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-ea186ba7-146a-4e99-bf68-ed83ee9a5765-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-328123f7-6bce-4016-a94c-9b8cd582df7b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-328123f7-6bce-4016-a94c-9b8cd582df7b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-quobyte-328123f7-6bce-4016-a94c-9b8cd582df7b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-328123f7-6bce-4016-a94c-9b8cd582df7b" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772ae01-5535-4740-8feb-fab3ddd9a4fd]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:18 devstack quobyte-client[83978]: System call of process 92966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b" returned: 0 in 0.561s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-328123f7-6bce-4016-a94c-9b8cd582df7b" returned: 0 in 0.121s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-328123f7-6bce-4016-a94c-9b8cd582df7b" released by "delete_volume" :: held 0.901s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Created reservations ['b42421a8-a160-4262-8a5a-8d9781787068', '2e57db44-e529-4195-8611-3d54bef58007', 'c134b7cc-007f-4b52-9b3c-bb54ca4a5341', '4a5d616a-8367-4097-ae01-94833fe2a362'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.133s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:46:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Deleted volume successfully.
Sep 25 19:46:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-91b4f14f-9344-4f87-b574-43c01b7cd51e tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-328123f7-6bce-4016-a94c-9b8cd582df7b-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-fc859e41-8b7e-4860-a519-e7b1a120246d-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-fc859e41-8b7e-4860-a519-e7b1a120246d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:20 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "cinder-quobyte-fc859e41-8b7e-4860-a519-e7b1a120246d" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-fc859e41-8b7e-4860-a519-e7b1a120246d" acquired by "delete_volume" :: waited 0.019s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cee6c1-1f30-4a7c-a3f3-a50c76f1d854]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:46:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 0.422s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:21 devstack quobyte-client[83978]: System call of process 92973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 1 in 0.485s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fc859e41-8b7e-4860-a519-e7b1a120246d" returned: 0 in 0.113s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-quobyte-fc859e41-8b7e-4860-a519-e7b1a120246d" released by "delete_volume" :: held 1.302s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Created reservations ['6f711490-4e54-4ebe-bd45-d031bd23614c', '1bee344e-f82e-4cf3-8c68-6b981ad60925', 'fcc8ba87-5657-4fa8-b65e-738da76fb409', 'e9ece461-0905-4717-afd4-fcd48403a1b9'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:46:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Deleted volume successfully.
Sep 25 19:46:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c4558a6c-d528-4d13-89be-34a9557d0134 tempest-TaggedBootDevicesTest-534282896 None] Lock "cinder-fc859e41-8b7e-4860-a519-e7b1a120246d-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:46:32 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=18,cinder:UPDATE=35,cinder:INSERT=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:46:32 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=13,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:46:53 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (1b90a23a-2004-4013-b79e-0a87f310899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0424646f-569e-4ecb-85b1-7776a26f4884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0424646f-569e-4ecb-85b1-7776a26f4884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-859864391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608f44e5-e57b-4ddb-accf-293e98b77d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:46:53Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998dfb3-53ed-4ca4-ac83-88fd8faf21a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998dfb3-53ed-4ca4-ac83-88fd8faf21a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e177b7-1779-4768-89b1-d47000c3fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e177b7-1779-4768-89b1-d47000c3fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608f44e5-e57b-4ddb-accf-293e98b77d1f', 'volume_name': 'volume-608f44e5-e57b-4ddb-accf-293e98b77d1f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab089fa-6c5b-44bf-b8fc-470212ef7a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab089fa-6c5b-44bf-b8fc-470212ef7a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83401fb-0fbb-43f8-aac1-c4103b3c859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:53 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Volume 608f44e5-e57b-4ddb-accf-293e98b77d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608f44e5-e57b-4ddb-accf-293e98b77d1f', 'volume_size': 1}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-859864391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608f44e5-e57b-4ddb-accf-293e98b77d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:46:53Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Creating volume 608f44e5-e57b-4ddb-accf-293e98b77d1f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:46:53 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:46:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:53 devstack quobyte-client[83978]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:53 devstack quobyte-client[83978]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:53 devstack quobyte-client[83978]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:53 devstack quobyte-client[83978]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:53 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=45, name=volume-608f44e5-e57b-4ddb-accf-293e98b77d1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f 1073741824" returned: 0 in 0.543s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f" returned: 0 in 0.420s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] <== create_volume: return (1071ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83401fb-0fbb-43f8-aac1-c4103b3c859a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608f44e5-e57b-4ddb-accf-293e98b77d1f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7e75c3-fd0e-4f65-8b98-9391be053ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.550s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:46:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Volume volume-608f44e5-e57b-4ddb-accf-293e98b77d1f (608f44e5-e57b-4ddb-accf-293e98b77d1f): created successfully
Sep 25 19:46:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7e75c3-fd0e-4f65-8b98-9391be053ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:46:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (1b90a23a-2004-4013-b79e-0a87f310899a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:46:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a74e63ac-fa0c-4645-87c2-a4a3e653dd5c tempest-AttachVolumeNegativeTest-1944782245 None] Created volume successfully.
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e79bb-49e5-4baf-974b-ae51126f0242]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:46:59 devstack quobyte-client[83978]: System call of process 93089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f" returned: 0 in 0.518s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:46:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.591s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:47:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-608f44e5-e57b-4ddb-accf-293e98b77d1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f225cb58-1d51-49dc-a5db-67c5e85a4dcb', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:47:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:47:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-dbfeac7f-e205-4e1a-998e-4388906b4734 req-b773b144-08c5-4081-b9bb-12e7f5e0009d tempest-AttachVolumeNegativeTest-1944782245 None] attachment_update completed successfully.
Sep 25 19:47:10 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:47:10 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:47:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-38fbc674-d336-4e56-a235-48bff2ba75dc req-1e1edd90-109e-4ca5-933e-ff17f5ccbe87 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:47:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-38fbc674-d336-4e56-a235-48bff2ba75dc req-1e1edd90-109e-4ca5-933e-ff17f5ccbe87 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:47:31 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-38fbc674-d336-4e56-a235-48bff2ba75dc req-1e1edd90-109e-4ca5-933e-ff17f5ccbe87 tempest-TestShelveInstance-1584022448 None] Terminate volume connection completed successfully.
Sep 25 19:47:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-38fbc674-d336-4e56-a235-48bff2ba75dc req-1e1edd90-109e-4ca5-933e-ff17f5ccbe87 tempest-TestShelveInstance-1584022448 None] Deleting attachment 536926e4-7ad9-44c4-898b-fc5a619a7e39. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:47:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:47:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:47:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:47:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:47:53 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0b6d32-087a-48e6-8e4d-a08d9303a374]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:47:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:47:54 devstack quobyte-client[83978]: System call of process 93444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:54 devstack quobyte-client[83978]: System call of process 93444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:47:54 devstack quobyte-client[83978]: System call of process 93444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 1.407s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:47:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:47:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.555s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:47:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:47:55 devstack quobyte-client[83978]: System call of process 93452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:55 devstack quobyte-client[83978]: System call of process 93452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:55 devstack quobyte-client[83978]: System call of process 93452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:47:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 1 in 1.272s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:47:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:47:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.182s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:47:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-798f4486-0f2c-40eb-9719-785bcce4dd7e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '900e85af-3eef-4114-be5f-63d1b76fc44b', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:47:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:47:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-1db352e5-c71c-4b3d-8fa2-730c3def88a6 req-d9b61da5-2884-46bc-814d-12d0ecfd3779 tempest-TestShelveInstance-1584022448 None] attachment_update completed successfully.
Sep 25 19:48:07 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:48:07 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:48:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Flow 'volume_create_manager' (d6a7c349-4746-4581-9e59-4e92db13719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4762b-81d2-47e9-a686-88c85fa6f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c4762b-81d2-47e9-a686-88c85fa6f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1986279414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d375e78-ecfe-43bb-afbf-f4c22f032308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141d9db6e29249caa68fbed0faa3b05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:48:37Z,use_quota=True,user_id='113664b6c264469b94b140b8999071ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d384ef-35d8-4a6b-bc0c-2173a1367ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d384ef-35d8-4a6b-bc0c-2173a1367ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f25bd-1070-4aea-8c4e-04ff61e9856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f25bd-1070-4aea-8c4e-04ff61e9856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d375e78-ecfe-43bb-afbf-f4c22f032308', 'volume_name': 'volume-5d375e78-ecfe-43bb-afbf-f4c22f032308', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7b707-367a-4426-8e75-d6681bb18554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7b707-367a-4426-8e75-d6681bb18554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0bdea5-b0be-420b-b49d-013bf084f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Volume 5d375e78-ecfe-43bb-afbf-f4c22f032308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d375e78-ecfe-43bb-afbf-f4c22f032308', 'volume_size': 1}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1986279414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d375e78-ecfe-43bb-afbf-f4c22f032308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141d9db6e29249caa68fbed0faa3b05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:48:37Z,use_quota=True,user_id='113664b6c264469b94b140b8999071ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Creating volume 5d375e78-ecfe-43bb-afbf-f4c22f032308 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:48:37 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:48:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:37 devstack quobyte-client[83978]: System call of process 93734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:48:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=46, name=volume-5d375e78-ecfe-43bb-afbf-f4c22f032308, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:48:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 1073741824" returned: 0 in 1.155s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308" returned: 0 in 0.199s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] <== create_volume: return (1512ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0bdea5-b0be-420b-b49d-013bf084f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d375e78-ecfe-43bb-afbf-f4c22f032308', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2508c5-3fb7-4a50-ae5f-e7b2b0165896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Volume volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 (5d375e78-ecfe-43bb-afbf-f4c22f032308): created successfully
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2508c5-3fb7-4a50-ae5f-e7b2b0165896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Flow 'volume_create_manager' (d6a7c349-4746-4581-9e59-4e92db13719d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:48:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0ac4d0b2-9a1b-4a7b-867e-98f900df8d1b tempest-ServersNegativeTestJSON-1060848798 None] Created volume successfully.
Sep 25 19:48:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:48:42 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:48:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Flow 'volume_create_manager' (e1e16f6f-82e6-42db-bb92-0803f794a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:48:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c0cd8-a44a-441e-be5b-f327ecad796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c0cd8-a44a-441e-be5b-f327ecad796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1332418044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcaafdd-5d43-4796-994d-9ac78dca7030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141d9db6e29249caa68fbed0faa3b05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:48:42Z,use_quota=True,user_id='113664b6c264469b94b140b8999071ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3c3376-de1f-4081-b55e-4758c2ee4dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3c3376-de1f-4081-b55e-4758c2ee4dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c2815f-0651-4c6f-9995-2ca946d725f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c2815f-0651-4c6f-9995-2ca946d725f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcaafdd-5d43-4796-994d-9ac78dca7030', 'volume_name': 'volume-ebcaafdd-5d43-4796-994d-9ac78dca7030', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f03e77-dd65-4b65-b2fe-74dff866abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f03e77-dd65-4b65-b2fe-74dff866abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10062f5d-730b-44c8-9364-2a89ec402520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:43 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Volume ebcaafdd-5d43-4796-994d-9ac78dca7030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcaafdd-5d43-4796-994d-9ac78dca7030', 'volume_size': 1}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1332418044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcaafdd-5d43-4796-994d-9ac78dca7030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141d9db6e29249caa68fbed0faa3b05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:48:42Z,use_quota=True,user_id='113664b6c264469b94b140b8999071ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Creating volume ebcaafdd-5d43-4796-994d-9ac78dca7030 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:48:43 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:43 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=47, name=volume-ebcaafdd-5d43-4796-994d-9ac78dca7030, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 1073741824" returned: 0 in 0.502s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030" returned: 0 in 0.273s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] <== create_volume: return (950ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10062f5d-730b-44c8-9364-2a89ec402520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcaafdd-5d43-4796-994d-9ac78dca7030', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d183dc0c-4f9c-40a3-a1f1-865c08ee3a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:48:44 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Volume volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 (ebcaafdd-5d43-4796-994d-9ac78dca7030): created successfully
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d183dc0c-4f9c-40a3-a1f1-865c08ee3a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:48:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Flow 'volume_create_manager' (e1e16f6f-82e6-42db-bb92-0803f794a536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:48:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8793c27c-7b58-481d-8278-c7cba366efde tempest-ServersNegativeTestJSON-1060848798 None] Created volume successfully.
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "cinder-ebcaafdd-5d43-4796-994d-9ac78dca7030-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-ebcaafdd-5d43-4796-994d-9ac78dca7030-delete_volume" acquired by "delete_volume" :: waited 0.208s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:48:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "cinder-quobyte-ebcaafdd-5d43-4796-994d-9ac78dca7030" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-quobyte-ebcaafdd-5d43-4796-994d-9ac78dca7030" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4554e86f-683c-46d7-90a7-e65c05f378ab]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:48:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:47 devstack quobyte-client[83978]: System call of process 93772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:48:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030" returned: 0 in 0.930s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ebcaafdd-5d43-4796-994d-9ac78dca7030" returned: 0 in 0.217s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-quobyte-ebcaafdd-5d43-4796-994d-9ac78dca7030" released by "delete_volume" :: held 1.547s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Created reservations ['68b0c6f2-92a9-4e07-a0f9-5b20d31e1fad', '954fe629-b08f-4268-a61d-bbed94c4fb2a', '29905e41-36ae-4273-945f-223d1a18d966', 'd75fb8db-413a-403f-ba41-c3c8484a2e6a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.200s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:49 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:48:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Deleted volume successfully.
Sep 25 19:48:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "cinder-5d375e78-ecfe-43bb-afbf-f4c22f032308-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:48:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-078cf64f-1dc0-4154-bf25-c64436ab5993 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-ebcaafdd-5d43-4796-994d-9ac78dca7030-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:48:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-5d375e78-ecfe-43bb-afbf-f4c22f032308-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:48:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:48:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "cinder-quobyte-5d375e78-ecfe-43bb-afbf-f4c22f032308" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:48:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-quobyte-5d375e78-ecfe-43bb-afbf-f4c22f032308" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:48:50 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7611b38-15f8-4814-a6c6-4a2060f9f51a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:48:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308" returned: 0 in 0.924s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d375e78-ecfe-43bb-afbf-f4c22f032308" returned: 0 in 0.253s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-quobyte-5d375e78-ecfe-43bb-afbf-f4c22f032308" released by "delete_volume" :: held 1.600s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Created reservations ['0bf09c6d-dda2-4434-be8d-218785011ef2', '9bf23dab-a778-4198-a76a-a9af994cd8cd', '17764b3a-17c6-4eb7-bece-1440a0e7ccee', '3303f829-b78e-4893-8d05-80d06542da94'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.176s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:52 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:48:52 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Deleted volume successfully.
Sep 25 19:48:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-75689191-722f-415d-94f9-935f8e379db6 tempest-ServersNegativeTestJSON-1060848798 None] Lock "cinder-5d375e78-ecfe-43bb-afbf-f4c22f032308-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.277s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:48:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:49:02 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=28,cinder:SELECT=10,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:49:03 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:49:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:49:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:49:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.430s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:49:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:49:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-97d766ff-101d-48f2-bfae-7fea6b937332 req-4acc32af-431b-4002-83e6-83c4472d15c2 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:49:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-97d766ff-101d-48f2-bfae-7fea6b937332 req-4acc32af-431b-4002-83e6-83c4472d15c2 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:49:56 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-97d766ff-101d-48f2-bfae-7fea6b937332 req-4acc32af-431b-4002-83e6-83c4472d15c2 tempest-AttachVolumeNegativeTest-1944782245 None] Terminate volume connection completed successfully.
Sep 25 19:49:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-97d766ff-101d-48f2-bfae-7fea6b937332 req-4acc32af-431b-4002-83e6-83c4472d15c2 tempest-AttachVolumeNegativeTest-1944782245 None] Deleting attachment f225cb58-1d51-49dc-a5db-67c5e85a4dcb. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:49:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-aece9c02-5134-4692-b12c-687aea74817e req-2b975b88-b499-4153-b66c-fa6cadc47a25 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:49:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-aece9c02-5134-4692-b12c-687aea74817e req-2b975b88-b499-4153-b66c-fa6cadc47a25 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:49:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-aece9c02-5134-4692-b12c-687aea74817e req-2b975b88-b499-4153-b66c-fa6cadc47a25 tempest-TestShelveInstance-1584022448 None] Terminate volume connection completed successfully.
Sep 25 19:49:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-aece9c02-5134-4692-b12c-687aea74817e req-2b975b88-b499-4153-b66c-fa6cadc47a25 tempest-TestShelveInstance-1584022448 None] Deleting attachment 900e85af-3eef-4114-be5f-63d1b76fc44b. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:49:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Acquiring lock "cinder-798f4486-0f2c-40eb-9719-785bcce4dd7e-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:49:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "cinder-798f4486-0f2c-40eb-9719-785bcce4dd7e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:49:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:49:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Acquiring lock "cinder-quobyte-798f4486-0f2c-40eb-9719-785bcce4dd7e" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:49:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "cinder-quobyte-798f4486-0f2c-40eb-9719-785bcce4dd7e" acquired by "delete_volume" :: waited 0.024s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:49:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b2d18c-bfbc-4162-bcda-e6ff4ef65a96]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:49:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 1.787s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 1 in 0.754s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-798f4486-0f2c-40eb-9719-785bcce4dd7e" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "cinder-quobyte-798f4486-0f2c-40eb-9719-785bcce4dd7e" released by "delete_volume" :: held 2.991s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG cinder.quota [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Created reservations ['cd5c2b41-ecbe-449f-8554-d7ced2d8813f', 'ab358dc4-b0a4-4317-8b76-cf4341eb7b5f', '5dcf1dd8-ef8a-4ebd-b7e3-bb9fa9d2a608', 'f3aa5c05-06b1-416d-9292-a5c81c20c765'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.117s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:02 devstack cinder-volume[83952]: DEBUG cinder.manager [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:03 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Deleted volume successfully.
Sep 25 19:50:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-aece9c02-5134-4692-b12c-687aea74817e req-02b5bf9b-ac98-4822-9f2d-6926c7fc80c0 tempest-TestShelveInstance-1584022448 None] Lock "cinder-798f4486-0f2c-40eb-9719-785bcce4dd7e-delete_volume" released by "delete_volume" :: held 4.879s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:50:13 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:50:27 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:27 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (d245528f-8177-4332-bb54-4265c0a4a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce52fd64-f9df-41c7-97b1-97bbdf89998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce52fd64-f9df-41c7-97b1-97bbdf89998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-554578723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:28Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8edc10e-8730-439a-a8ad-7e6b5776abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8edc10e-8730-439a-a8ad-7e6b5776abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66642cdd-b8b7-446b-a86e-cfad7164670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66642cdd-b8b7-446b-a86e-cfad7164670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b9fd2c-2942-47e8-84b3-9e3e65d72e6e', 'volume_name': 'volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b1e78d-7852-4acf-a39d-32b06752b6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b1e78d-7852-4acf-a39d-32b06752b6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74097e73-1873-40a5-86c0-cda987e83ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:28 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Volume d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e', 'volume_size': 1}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-554578723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:28Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Creating volume d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:50:28 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:50:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:28 devstack quobyte-client[83978]: System call of process 94226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:28 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=48, name=volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:50:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e 1073741824" returned: 0 in 1.308s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (d2988788-c9d4-43c5-9b93-f9a22c8d77cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fadbfb8-f189-4710-bc35-86459d263ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" returned: 0 in 0.889s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] <== create_volume: return (2343ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.353s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fadbfb8-f189-4710-bc35-86459d263ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124022146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05307957-3849-4703-9e6b-02d9bee3d2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:28Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac2b1a-cb91-4e8a-98b5-f7b87adce78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac2b1a-cb91-4e8a-98b5-f7b87adce78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56879964-f05f-431b-8d77-c1f90f7587d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56879964-f05f-431b-8d77-c1f90f7587d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05307957-3849-4703-9e6b-02d9bee3d2e9', 'volume_name': 'volume-05307957-3849-4703-9e6b-02d9bee3d2e9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d174369-1162-478d-833a-f7e4a0634865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d174369-1162-478d-833a-f7e4a0634865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146b4627-d3dc-4e74-a635-444fcdfe7a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Volume 05307957-3849-4703-9e6b-02d9bee3d2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05307957-3849-4703-9e6b-02d9bee3d2e9', 'volume_size': 1}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124022146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05307957-3849-4703-9e6b-02d9bee3d2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:28Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Creating volume 05307957-3849-4703-9e6b-02d9bee3d2e9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:50:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:50:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:30 devstack quobyte-client[83978]: System call of process 94249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:30 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=49, name=volume-05307957-3849-4703-9e6b-02d9bee3d2e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (3d95e4d1-a02f-4e56-94f0-c0662b3b38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4369c56d-c6c8-4f95-8369-cb2137c60f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (092742a6-2312-4a4d-ba4f-be450c404a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0b799f-e878-4623-b627-39187eaae387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0b799f-e878-4623-b627-39187eaae387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578163510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0745ff86-0fbf-4401-8514-c86c5730af31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:30Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac6b700-74e4-4523-871c-b488d4170a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac6b700-74e4-4523-871c-b488d4170a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefac26-14a5-4d4f-b41d-221cba7e0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefac26-14a5-4d4f-b41d-221cba7e0e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0745ff86-0fbf-4401-8514-c86c5730af31', 'volume_name': 'volume-0745ff86-0fbf-4401-8514-c86c5730af31', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258de99b-2bb4-4792-af9b-edb5e1f70935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258de99b-2bb4-4792-af9b-edb5e1f70935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082f7c3-4efe-4b10-8fbd-6df62dfd2b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Volume 0745ff86-0fbf-4401-8514-c86c5730af31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0745ff86-0fbf-4401-8514-c86c5730af31', 'volume_size': 1}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74097e73-1873-40a5-86c0-cda987e83ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207ed03-42c4-4fb9-a62f-ae2c65033290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4369c56d-c6c8-4f95-8369-cb2137c60f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-222374276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fcddc6-2188-4878-9210-a9218bb14da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:29Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af77475c-1070-4f5a-97da-ab24d01648fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af77475c-1070-4f5a-97da-ab24d01648fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0937c12-049d-4ad0-ba00-ae32fd4d3dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0937c12-049d-4ad0-ba00-ae32fd4d3dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fcddc6-2188-4878-9210-a9218bb14da7', 'volume_name': 'volume-35fcddc6-2188-4878-9210-a9218bb14da7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc610b68-31ca-4fd3-a289-98291709382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc610b68-31ca-4fd3-a289-98291709382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a352326-b833-4fdc-a7ad-47432c43d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:31 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Volume 35fcddc6-2188-4878-9210-a9218bb14da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fcddc6-2188-4878-9210-a9218bb14da7', 'volume_size': 1}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:31 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Volume volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e (d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e): created successfully
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207ed03-42c4-4fb9-a62f-ae2c65033290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (d245528f-8177-4332-bb54-4265c0a4a265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9 1073741824" returned: 0 in 1.154s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (2c149f6e-5bf5-4d38-a145-da5d751e522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915e1b6-5445-4b19-9885-cc93630f57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915e1b6-5445-4b19-9885-cc93630f57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1444204144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:31Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d4d03e-33af-4217-b0fd-ce5e5d196216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d4d03e-33af-4217-b0fd-ce5e5d196216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f5a66d-e0ab-4157-90a9-650a8275ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f5a66d-e0ab-4157-90a9-650a8275ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7', 'volume_name': 'volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7ff254-8259-4aec-b457-cbd9143c59b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7ff254-8259-4aec-b457-cbd9143c59b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76f5c0d-f872-46a7-8541-0fc00f496170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Volume 19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7', 'volume_size': 1}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d3790752-dc6c-41ea-ba06-98005a4f281b tempest-CreateVolumesFromImageTest-1871925115 None] Created volume successfully.
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9" returned: 0 in 0.473s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] <== create_volume: return (1701ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578163510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0745ff86-0fbf-4401-8514-c86c5730af31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:30Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Creating volume 0745ff86-0fbf-4401-8514-c86c5730af31 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:50:32 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:50:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:33 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=50, name=volume-0745ff86-0fbf-4401-8514-c86c5730af31, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146b4627-d3dc-4e74-a635-444fcdfe7a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05307957-3849-4703-9e6b-02d9bee3d2e9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11fbeb1-9589-42a3-91cc-5785d4a91a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Volume volume-05307957-3849-4703-9e6b-02d9bee3d2e9 (05307957-3849-4703-9e6b-02d9bee3d2e9): created successfully
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11fbeb1-9589-42a3-91cc-5785d4a91a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (d2988788-c9d4-43c5-9b93-f9a22c8d77cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31 1073741824" returned: 0 in 1.232s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0daeec6a-859e-4cc3-8aca-81cd33465ca3 tempest-CreateVolumesFromImageTest-1871925115 None] Created volume successfully.
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31" returned: 0 in 0.615s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] <== create_volume: return (1930ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-222374276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fcddc6-2188-4878-9210-a9218bb14da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:29Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Creating volume 35fcddc6-2188-4878-9210-a9218bb14da7 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:50:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:34 devstack quobyte-client[83978]: System call of process 94297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:34 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=51, name=volume-35fcddc6-2188-4878-9210-a9218bb14da7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6082f7c3-4efe-4b10-8fbd-6df62dfd2b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0745ff86-0fbf-4401-8514-c86c5730af31', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc99f685-be70-4e6e-96c6-af25a87d69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7 1073741824" returned: 0 in 0.513s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Volume volume-0745ff86-0fbf-4401-8514-c86c5730af31 (0745ff86-0fbf-4401-8514-c86c5730af31): created successfully
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc99f685-be70-4e6e-96c6-af25a87d69c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (092742a6-2312-4a4d-ba4f-be450c404a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7" returned: 0 in 0.285s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] <== create_volume: return (835ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1444204144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7f4eb1c3df4bb381469ddbc1f77113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:50:31Z,use_quota=True,user_id='b0de05977bb84a03a33c204bd954f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Creating volume 19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:50:35 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:50:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-983b51c5-de06-4195-8219-4735bf6e2e29 tempest-CreateVolumesFromImageTest-1871925115 None] Created volume successfully.
Sep 25 19:50:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=52, name=volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a352326-b833-4fdc-a7ad-47432c43d91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fcddc6-2188-4878-9210-a9218bb14da7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5653d71b-4d92-4299-b2d9-7aeb358004e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:36 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Volume volume-35fcddc6-2188-4878-9210-a9218bb14da7 (35fcddc6-2188-4878-9210-a9218bb14da7): created successfully
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5653d71b-4d92-4299-b2d9-7aeb358004e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (3d95e4d1-a02f-4e56-94f0-c0662b3b38d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 1073741824" returned: 0 in 0.806s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d73602b3-4e9e-4bf3-bd74-e1cec4dd4100 tempest-CreateVolumesFromImageTest-1871925115 None] Created volume successfully.
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" returned: 0 in 0.312s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] <== create_volume: return (1149ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76f5c0d-f872-46a7-8541-0fc00f496170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8091f5e-229d-4a6d-96ce-76d149445df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:50:36 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Volume volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 (19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7): created successfully
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8091f5e-229d-4a6d-96ce-76d149445df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:50:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Flow 'volume_create_manager' (2c149f6e-5bf5-4d38-a145-da5d751e522b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:50:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-efef50c9-8d62-4284-a11c-677e4ac535fa tempest-CreateVolumesFromImageTest-1871925115 None] Created volume successfully.
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-quobyte-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" acquired by "delete_volume" :: waited 0.026s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[41345e28-82b8-4a35-b67f-9023d89269ce]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:50:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:38 devstack quobyte-client[83978]: System call of process 94310 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:38 devstack quobyte-client[83978]: System call of process 94310 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" returned: 0 in 1.079s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" returned: 0 in 0.383s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7" released by "delete_volume" :: held 1.985s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Created reservations ['6cc3a38f-b49b-4db3-b796-7389bdc94faf', 'f58aa10b-2567-41f4-8965-1dd373589f71', '7fd12954-76ee-4e06-a1fc-9c402efe243f', '49faeeaf-329b-4db7-b7f8-825eab582907'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.042s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-0745ff86-0fbf-4401-8514-c86c5730af31-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 1.068s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:41 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Deleted volume successfully.
Sep 25 19:50:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-0745ff86-0fbf-4401-8514-c86c5730af31-delete_volume" acquired by "delete_volume" :: waited 1.165s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7fa08b8-3b9b-40b9-b66d-b7d9333f804d tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-19fd34e1-e22a-431b-bc2a-3c3b5f3c29e7-delete_volume" released by "delete_volume" :: held 5.288s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-quobyte-0745ff86-0fbf-4401-8514-c86c5730af31" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-0745ff86-0fbf-4401-8514-c86c5730af31" acquired by "delete_volume" :: waited 0.051s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:43 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d719b-1e63-4e1c-9bdd-71cb424fe99e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:50:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31" returned: 0 in 1.134s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0745ff86-0fbf-4401-8514-c86c5730af31" returned: 0 in 0.134s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-0745ff86-0fbf-4401-8514-c86c5730af31" released by "delete_volume" :: held 1.614s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:44 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Created reservations ['3a27df10-c266-4c3c-9398-4010938cde15', '4efb4172-f077-4b74-bd49-15027dbc49b2', '017fe84c-d121-4740-be03-452ecc5198c2', 'b398e840-32c9-4786-86d5-c3da1fb69b0a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.186s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Deleted volume successfully.
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-53711621-6c9c-489f-8b97-e2235a38aed3 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-0745ff86-0fbf-4401-8514-c86c5730af31-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-35fcddc6-2188-4878-9210-a9218bb14da7-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-35fcddc6-2188-4878-9210-a9218bb14da7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-quobyte-35fcddc6-2188-4878-9210-a9218bb14da7" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-35fcddc6-2188-4878-9210-a9218bb14da7" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4972c84-f8c0-4e74-a1aa-71547f492f00]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:50:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:46 devstack quobyte-client[83978]: System call of process 94409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7" returned: 0 in 0.759s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-35fcddc6-2188-4878-9210-a9218bb14da7" returned: 0 in 0.151s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-35fcddc6-2188-4878-9210-a9218bb14da7" released by "delete_volume" :: held 1.157s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Created reservations ['179129d3-aa13-4f8e-8680-a36b5e9daa28', 'd9859fda-d16f-4ae3-92a3-3e062905c3cc', 'a67523d9-e1a9-446f-aa4f-04bca6a03d63', '1b33d900-8a7f-47cf-ba97-481d04527c09'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:47 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Deleted volume successfully.
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9e1964b-428f-4b3e-ad66-5a48f2a6bede tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-35fcddc6-2188-4878-9210-a9218bb14da7-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-05307957-3849-4703-9e6b-02d9bee3d2e9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-05307957-3849-4703-9e6b-02d9bee3d2e9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-quobyte-05307957-3849-4703-9e6b-02d9bee3d2e9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-05307957-3849-4703-9e6b-02d9bee3d2e9" acquired by "delete_volume" :: waited 0.025s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd978ee7-096b-42e2-ba6a-080579fdf539]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:50:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:49 devstack quobyte-client[83978]: System call of process 94424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9" returned: 0 in 0.439s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-05307957-3849-4703-9e6b-02d9bee3d2e9" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-05307957-3849-4703-9e6b-02d9bee3d2e9" released by "delete_volume" :: held 0.830s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Created reservations ['dfdad76a-d7bf-48cc-984d-8bc0d7a6dd81', 'ba1b492b-d331-4b24-ba01-934e6485f800', '3829f419-6280-4d8e-abbd-a8862bf25271', 'd43b17aa-b1c6-4b54-969d-04399476371d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.680s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Deleted volume successfully.
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a91300d6-104b-45ad-9a5f-ababe797a96f tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-05307957-3849-4703-9e6b-02d9bee3d2e9-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:51 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "cinder-quobyte-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:50:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:50:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513cb6c-c4c7-42e1-84b2-aca8d0a01269]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:50:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:52 devstack quobyte-client[83978]: System call of process 94430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:50:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" returned: 0 in 1.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" returned: 0 in 0.215s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-quobyte-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e" released by "delete_volume" :: held 1.770s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Created reservations ['2984f6c4-f020-4d19-a673-88f1e39e9130', 'd34aa649-8f95-4663-8103-1e7280ddb9f3', '41110b81-6881-4a16-b81b-d6be88f3fdaa', '20860a59-53ef-4b75-851b-8b77dbbbdf97'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.530s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.304s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:50:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:50:56 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Deleted volume successfully.
Sep 25 19:50:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1467dbf4-b230-4078-9182-1ac89c3c3ee4 tempest-CreateVolumesFromImageTest-1871925115 None] Lock "cinder-d5b9fd2c-2942-47e8-84b3-9e3e65d72e6e-delete_volume" released by "delete_volume" :: held 5.014s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (9822db17-d204-4154-99cd-0c47294015f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c589e-c6e9-47de-af4d-721a69691a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c589e-c6e9-47de-af4d-721a69691a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208411280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d7cfa1-e156-4c71-bc8d-d20a82be3d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:00Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c7c5b1-7b28-4507-a885-04817faf4019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c7c5b1-7b28-4507-a885-04817faf4019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a13f1a0-a9ca-4ca2-866d-f8c46833a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a13f1a0-a9ca-4ca2-866d-f8c46833a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d7cfa1-e156-4c71-bc8d-d20a82be3d08', 'volume_name': 'volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27330d0-b9d2-4dd0-8769-fd4c5702138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27330d0-b9d2-4dd0-8769-fd4c5702138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7214da-f183-4a25-97d7-50a920bd7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:00 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume 97d7cfa1-e156-4c71-bc8d-d20a82be3d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08', 'volume_size': 1}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208411280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d7cfa1-e156-4c71-bc8d-d20a82be3d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:00Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume 97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:00 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:01 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=53, name=volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 1073741824" returned: 0 in 0.347s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" returned: 0 in 0.137s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (557ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7214da-f183-4a25-97d7-50a920bd7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0c33c-537c-4b35-8aa6-b3c3be42c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:01 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 (97d7cfa1-e156-4c71-bc8d-d20a82be3d08): created successfully
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0c33c-537c-4b35-8aa6-b3c3be42c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (9822db17-d204-4154-99cd-0c47294015f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7e3146da-f403-4cbe-bafe-f6664539709b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating offline snapshot ba0287c1-1b48-4f25-88d3-d4d154b27814 of volume 97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:51:03 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[59302d48-b90d-4d04-b887-54b1a5c78012]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" returned: 0 in 0.568s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:04 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=54, name=volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 1G" returned: 0 in 0.281s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img rebase -u -b volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:04 devstack quobyte-client[83978]: System call of process 94466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:04 devstack quobyte-client[83978]: System call of process 94466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:04 devstack quobyte-client[83978]: System call of process 94466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img rebase -u -b volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.245s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.115s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:51:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.131s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.info" returned: 0 in 0.124s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.info" returned: 0 in 0.127s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4c793bfe-9d83-458f-a8dc-a431ea563304 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Create snapshot completed successfully
Sep 25 19:51:07 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (5fc374ff-9493-4e4c-9420-62f396a67630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e6b41e-5777-45a0-9554-31b95973df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e6b41e-5777-45a0-9554-31b95973df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254050077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9a9725-f15d-45de-b775-c51fba4589e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:07Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878f8566-fb9a-4909-9a2a-d6af617747c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878f8566-fb9a-4909-9a2a-d6af617747c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52850de5-3250-4e5f-a924-68c2d4cde2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52850de5-3250-4e5f-a924-68c2d4cde2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9a9725-f15d-45de-b775-c51fba4589e1', 'volume_name': 'volume-6f9a9725-f15d-45de-b775-c51fba4589e1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2646a5d4-6f6a-4365-bbe4-5763800e1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2646a5d4-6f6a-4365-bbe4-5763800e1b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f32d83a-978b-4a0c-93d6-c234621f124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume 6f9a9725-f15d-45de-b775-c51fba4589e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9a9725-f15d-45de-b775-c51fba4589e1', 'volume_size': 1}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1254050077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9a9725-f15d-45de-b775-c51fba4589e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:07Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume 6f9a9725-f15d-45de-b775-c51fba4589e1 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:07 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:07 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=56, name=volume-6f9a9725-f15d-45de-b775-c51fba4589e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1 1073741824" returned: 0 in 1.649s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:09 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (29d3e76f-360f-4950-bd92-5c8ebbd2ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4628fee-1a9e-4326-8c61-87ea7a029636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1" returned: 0 in 1.719s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (9e55653a-bc7a-4370-9ab8-cbb725c5847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeea28cd-665f-4584-b5e7-bb3d030d7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4628fee-1a9e-4326-8c61-87ea7a029636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508236414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3de94fc-9b0d-4802-b638-ce5d0dddd277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:08Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02de7d99-3978-42a8-b58f-8f6043d12647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02de7d99-3978-42a8-b58f-8f6043d12647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b493cb27-48c5-4db2-b705-2637ac9c2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b493cb27-48c5-4db2-b705-2637ac9c2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3de94fc-9b0d-4802-b638-ce5d0dddd277', 'volume_name': 'volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df55864b-8218-43e5-8fff-122a7129e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df55864b-8218-43e5-8fff-122a7129e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4243454-cb86-4d47-8cf3-191a8adca542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:10 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume f3de94fc-9b0d-4802-b638-ce5d0dddd277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277', 'volume_size': 1}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (3595ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.606s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508236414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3de94fc-9b0d-4802-b638-ce5d0dddd277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:08Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume f3de94fc-9b0d-4802-b638-ce5d0dddd277 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:10 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:11 devstack quobyte-client[83978]: System call of process 94481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:11 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=57, name=volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeea28cd-665f-4584-b5e7-bb3d030d7609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647051555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a600b5f-8aa7-497a-9465-93fc7fcdbdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:09Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a409f93-9348-46d3-ba51-1d6229b33ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a409f93-9348-46d3-ba51-1d6229b33ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1951f8-7420-4a67-8d68-f4973a8088d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1951f8-7420-4a67-8d68-f4973a8088d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a600b5f-8aa7-497a-9465-93fc7fcdbdd9', 'volume_name': 'volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a0b17-cc10-49b4-b17e-e3fa3727492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a0b17-cc10-49b4-b17e-e3fa3727492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ce5c22-138e-41ef-bf76-66c6397ae46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume 0a600b5f-8aa7-497a-9465-93fc7fcdbdd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9', 'volume_size': 1}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f32d83a-978b-4a0c-93d6-c234621f124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9a9725-f15d-45de-b775-c51fba4589e1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a27e698-6866-47a6-948a-f3ec68fb9505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (fff1861a-a068-4b9b-b44e-498255872b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca84b3fe-2c8d-4339-9009-8f0a56390f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (79065b3c-9098-4a3f-a053-9c06ffb9743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d89fa6-2abd-413c-afe9-63a62bce2c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:11 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Flow 'volume_create_manager' (7d1fb4b4-978a-4ebb-a687-6d3ddd497134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da9d4f-09c7-4fb4-ae94-28a3a60339c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca84b3fe-2c8d-4339-9009-8f0a56390f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550461672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf36af1-cdbf-4c12-80fa-8902c6535651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:11Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb3dc02-31c7-4fee-be23-e0c449fd4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb3dc02-31c7-4fee-be23-e0c449fd4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f92e2a-74fd-450e-804d-43726de0de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f92e2a-74fd-450e-804d-43726de0de5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf36af1-cdbf-4c12-80fa-8902c6535651', 'volume_name': 'volume-fdf36af1-cdbf-4c12-80fa-8902c6535651', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321d4b5-4065-4496-a06d-1d3bdf7f5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321d4b5-4065-4496-a06d-1d3bdf7f5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4abb35f-e6a6-4bef-9aba-645345878212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume fdf36af1-cdbf-4c12-80fa-8902c6535651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf36af1-cdbf-4c12-80fa-8902c6535651', 'volume_size': 1}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d89fa6-2abd-413c-afe9-63a62bce2c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-694303467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d9609c-af89-4212-8176-0172ff616f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:10Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e465dc-6eb8-4135-8306-4dcb0f8e38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e465dc-6eb8-4135-8306-4dcb0f8e38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5f094b-e959-4f0c-b9cd-ea45b759f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5f094b-e959-4f0c-b9cd-ea45b759f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d9609c-af89-4212-8176-0172ff616f0a', 'volume_name': 'volume-e3d9609c-af89-4212-8176-0172ff616f0a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e10c4b-6c13-4d74-aec0-4409a358ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e10c4b-6c13-4d74-aec0-4409a358ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea697fb-f90a-4b63-8e6e-ee6e2c73bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume e3d9609c-af89-4212-8176-0172ff616f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d9609c-af89-4212-8176-0172ff616f0a', 'volume_size': 1}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-6f9a9725-f15d-45de-b775-c51fba4589e1 (6f9a9725-f15d-45de-b775-c51fba4589e1): created successfully
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a27e698-6866-47a6-948a-f3ec68fb9505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (5fc374ff-9493-4e4c-9420-62f396a67630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 1073741824" returned: 0 in 1.345s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-323cd8be-3570-41de-baf7-31b1fb38aca8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da9d4f-09c7-4fb4-ae94-28a3a60339c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-816653149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e224b59545b42608c334de282e080d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:10Z,use_quota=True,user_id='25e6035560ab4f1e9e14e6760646e210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7320f78-9e8c-45fd-b49e-72563c830a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7320f78-9e8c-45fd-b49e-72563c830a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad865e-fbdb-46c6-b85a-f19fec61e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad865e-fbdb-46c6-b85a-f19fec61e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5', 'volume_name': 'volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416a9f70-1858-4e73-9908-ba4450156c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416a9f70-1858-4e73-9908-ba4450156c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b7231e-6e9c-498c-9224-dc4ed003edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5', 'volume_size': 1}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277" returned: 0 in 0.524s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (1895ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647051555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a600b5f-8aa7-497a-9465-93fc7fcdbdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:09Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume 0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:12 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:13 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=58, name=volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4243454-cb86-4d47-8cf3-191a8adca542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749f2265-d845-4d4c-aafa-9ac8b2e2a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:13 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 (f3de94fc-9b0d-4802-b638-ce5d0dddd277): created successfully
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749f2265-d845-4d4c-aafa-9ac8b2e2a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (29d3e76f-360f-4950-bd92-5c8ebbd2ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:13 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3c639856-ab93-4e7e-8a7a-58aa5f71b611 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 1073741824" returned: 0 in 0.882s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" returned: 0 in 0.160s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (1125ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550461672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf36af1-cdbf-4c12-80fa-8902c6535651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:11Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume fdf36af1-cdbf-4c12-80fa-8902c6535651 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:14 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:14 devstack quobyte-client[83978]: System call of process 94489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:14 devstack quobyte-client[83978]: System call of process 94489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ce5c22-138e-41ef-bf76-66c6397ae46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:14 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=59, name=volume-fdf36af1-cdbf-4c12-80fa-8902c6535651, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f952a0b-aea4-4114-9f8d-449b608f9100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:14 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 (0a600b5f-8aa7-497a-9465-93fc7fcdbdd9): created successfully
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f952a0b-aea4-4114-9f8d-449b608f9100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (9e55653a-bc7a-4370-9ab8-cbb725c5847a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ff030813-4d6f-44c5-8401-f358e3d3efbf tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 1073741824" returned: 0 in 0.808s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651" returned: 0 in 0.309s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (1254ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.318s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-694303467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d9609c-af89-4212-8176-0172ff616f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945daa1b567f4eb99cab2b3acabee2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:10Z,use_quota=True,user_id='bc6720fb8f06460d8b764b727749276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Creating volume e3d9609c-af89-4212-8176-0172ff616f0a {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:15 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:15 devstack quobyte-client[83978]: System call of process 94494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:15 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=60, name=volume-e3d9609c-af89-4212-8176-0172ff616f0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4abb35f-e6a6-4bef-9aba-645345878212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf36af1-cdbf-4c12-80fa-8902c6535651', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bd4d00-2212-4bf7-8cce-6f3776b2e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a 1073741824" returned: 0 in 0.747s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:16 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 (fdf36af1-cdbf-4c12-80fa-8902c6535651): created successfully
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bd4d00-2212-4bf7-8cce-6f3776b2e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (fff1861a-a068-4b9b-b44e-498255872b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a" returned: 0 in 0.425s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] <== create_volume: return (1211ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-816653149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e224b59545b42608c334de282e080d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:51:10Z,use_quota=True,user_id='25e6035560ab4f1e9e14e6760646e210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Creating volume ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:51:16 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:51:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:17 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=61, name=volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea697fb-f90a-4b63-8e6e-ee6e2c73bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d9609c-af89-4212-8176-0172ff616f0a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08756335-ff6d-4c4e-9483-aa560c21dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cfbe7751-bbcd-46b5-84d6-b311462e34a0 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume volume-e3d9609c-af89-4212-8176-0172ff616f0a (e3d9609c-af89-4212-8176-0172ff616f0a): created successfully
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08756335-ff6d-4c4e-9483-aa560c21dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Flow 'volume_create_manager' (79065b3c-9098-4a3f-a053-9c06ffb9743d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1752f005-8b4d-4bc6-a4fc-0dff2dd971a8 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created volume successfully.
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 1073741824" returned: 0 in 0.553s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" returned: 0 in 0.150s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b7231e-6e9c-498c-9224-dc4ed003edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7871aac-24c6-40fb-89f7-fd3497266477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:51:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 (ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5): created successfully
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7871aac-24c6-40fb-89f7-fd3497266477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:51:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Flow 'volume_create_manager' (7d1fb4b4-978a-4ebb-a687-6d3ddd497134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:51:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-50fb0f01-6f75-4e9b-bbdc-fda222e4a375 tempest-AttachVolumeShelveTestJSON-379407002 None] Created volume successfully.
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-fdf36af1-cdbf-4c12-80fa-8902c6535651-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-fdf36af1-cdbf-4c12-80fa-8902c6535651-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-fdf36af1-cdbf-4c12-80fa-8902c6535651" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-fdf36af1-cdbf-4c12-80fa-8902c6535651" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6381699-ab39-4eb5-9c90-19fd3afb0638]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651" returned: 0 in 0.555s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fdf36af1-cdbf-4c12-80fa-8902c6535651" returned: 0 in 0.156s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-fdf36af1-cdbf-4c12-80fa-8902c6535651" released by "delete_volume" :: held 0.919s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:19 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['1a1d9874-bdd4-440f-be28-bad7aa52f904', 'b6185944-a648-4d5a-bad3-6e4a97808309', '441b260b-b057-40ea-8ef4-f60bda84efb7', '9a3a3779-3825-46fa-9207-2150920ebf70'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7e66d4b6-64a8-47c6-ad93-32266f93d68b tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-fdf36af1-cdbf-4c12-80fa-8902c6535651-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-e3d9609c-af89-4212-8176-0172ff616f0a-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-e3d9609c-af89-4212-8176-0172ff616f0a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:21 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-e3d9609c-af89-4212-8176-0172ff616f0a" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-e3d9609c-af89-4212-8176-0172ff616f0a" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[be48851f-a771-465e-8570-bba52742a236]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a" returned: 0 in 0.472s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d9609c-af89-4212-8176-0172ff616f0a" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-e3d9609c-af89-4212-8176-0172ff616f0a" released by "delete_volume" :: held 0.740s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:22 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['f4b39411-1eb7-4863-b170-60090983f38c', '2f723b38-c9f4-4ec4-a2a2-5f1b2f18901e', '28be9f9f-6fd1-4875-b5ef-2152b137e649', '5f484a17-278f-4f26-85c5-f6b2004d09d8'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:22 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=45,cinder:UPDATE=86,cinder:DELETE=13,cinder:INSERT=12 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.046s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.221s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:23 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c680a7a0-0af1-427e-a896-73da8d6b419e tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-e3d9609c-af89-4212-8176-0172ff616f0a-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=76,cinder:SELECT=52,cinder:DELETE=6,cinder:INSERT=16 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:51:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef0709d-98f2-40df-a1c6-be908f32fd6b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:25 devstack quobyte-client[83978]: System call of process 94562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" returned: 0 in 0.539s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" returned: 0 in 0.094s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9" released by "delete_volume" :: held 0.824s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['596fd368-d6d7-4945-958d-7a8edf43817d', 'a213742f-1ba8-4fce-9213-7e929e05ad2b', 'f4be28a7-59b3-49e9-9f92-07ee04f2f6c1', '71313836-d38b-4eb6-8743-462b39e384f9'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:26 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:26 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-f3de94fc-9b0d-4802-b638-ce5d0dddd277-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-f3de94fc-9b0d-4802-b638-ce5d0dddd277-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a1377fdc-9d94-4d8c-b3e5-9e6832d4babc tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-0a600b5f-8aa7-497a-9465-93fc7fcdbdd9-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:27 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-f3de94fc-9b0d-4802-b638-ce5d0dddd277" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-f3de94fc-9b0d-4802-b638-ce5d0dddd277" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0fc275-8686-4883-a963-f0e638af3f10]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:27 devstack quobyte-client[83978]: System call of process 94576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:27 devstack quobyte-client[83978]: System call of process 94576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:27 devstack quobyte-client[83978]: System call of process 94576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:27 devstack quobyte-client[83978]: System call of process 94576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277" returned: 0 in 0.626s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f3de94fc-9b0d-4802-b638-ce5d0dddd277" returned: 0 in 0.183s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-f3de94fc-9b0d-4802-b638-ce5d0dddd277" released by "delete_volume" :: held 1.015s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['c40facbf-b3b4-4ba0-9cf9-b7b73dc749c1', '7c286930-343b-4e8a-a7a4-dc103962e391', 'c7a1cd69-5151-4ed7-ad61-46937f829057', '7b1804ec-6123-4c4d-87d8-6ec6f332b645'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.248s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:28 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:28 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-6f9a9725-f15d-45de-b775-c51fba4589e1-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6120a02f-7a23-40c4-b9ca-5e1783b1b16f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-f3de94fc-9b0d-4802-b638-ce5d0dddd277-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-6f9a9725-f15d-45de-b775-c51fba4589e1-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-6f9a9725-f15d-45de-b775-c51fba4589e1" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-6f9a9725-f15d-45de-b775-c51fba4589e1" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e69d2-a25d-4eac-9206-3307c7e3a74f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1" returned: 0 in 0.469s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6f9a9725-f15d-45de-b775-c51fba4589e1" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-6f9a9725-f15d-45de-b775-c51fba4589e1" released by "delete_volume" :: held 0.799s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['bf3aad4c-17d2-4145-9cfc-9ffb00e29490', '7ec30599-98d4-4cc6-a52d-d59ee0f25c7c', 'b60ceb11-1622-478e-9bf7-881d276d86fa', '6c92fccc-6496-4163-8938-5e0706deaf78'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-ba0287c1-1b48-4f25-88d3-d4d154b27814-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.646s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:31 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-ba0287c1-1b48-4f25-88d3-d4d154b27814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.167s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-ba0287c1-1b48-4f25-88d3-d4d154b27814" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f3a3b531-82a5-4cd7-b1ba-b7c654f9aeab tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-6f9a9725-f15d-45de-b775-c51fba4589e1-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-ba0287c1-1b48-4f25-88d3-d4d154b27814" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleting offline snapshot ba0287c1-1b48-4f25-88d3-d4d154b27814 of volume 97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] snapshot_file for this snap is: volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319777f-b6ef-4751-830d-9748ab59db73]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.571s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:51:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d93bbd-3f1c-40b1-a2c2-4b9b60eb9d11]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" returned: 0 in 0.638s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.280s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08.ba0287c1-1b48-4f25-88d3-d4d154b27814" returned: 0 in 0.134s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-ba0287c1-1b48-4f25-88d3-d4d154b27814" released by "_delete_snapshot" :: held 2.036s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" released by "delete_snapshot" :: held 2.148s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:34 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['2dc93964-9cc4-4d02-a94e-c24cc529e725', 'ca0e8de9-b84c-44ab-9a9d-796efaa8c9a8', 'ea04f9a9-068c-4943-8bd1-9fe1d48512db', 'a65730f8-42d0-4f5c-aae2-f961517ec5c9'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Delete snapshot completed successfully.
Sep 25 19:51:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0bd8380-eb01-427e-8329-2adfaad7523f tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-ba0287c1-1b48-4f25-88d3-d4d154b27814-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-97d7cfa1-e156-4c71-bc8d-d20a82be3d08-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-97d7cfa1-e156-4c71-bc8d-d20a82be3d08-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:34 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:51:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:51:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcf8fa-35ce-49d0-bfd9-60e23301de5b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" returned: 0 in 0.996s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-quobyte-97d7cfa1-e156-4c71-bc8d-d20a82be3d08" released by "delete_volume" :: held 1.364s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Created reservations ['2fee2acc-fb11-4db1-acf4-37542a91332e', '6bb9437f-b685-4687-9198-e52de60ac887', 'a60c8462-cd83-41f8-a121-03c2afd1d10f', '3f758ec8-58f3-4b3a-869a-49940758ac32'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:36 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Deleted volume successfully.
Sep 25 19:51:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-83840e61-64b8-4214-9b7d-9cc4d51f1498 tempest-CreateVolumesFromSnapshotTest-1821142988 None] Lock "cinder-97d7cfa1-e156-4c71-bc8d-d20a82be3d08-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:51:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0ccdf-4363-4254-b507-3b2b189191d0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:51:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:47 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=25,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=10 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:51:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" returned: 0 in 0.507s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.574s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf379dc5-add7-4569-b923-c423bae6826b', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:51:47 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:51:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-9a284f56-f993-4b65-9ea7-a8ba12005baf req-ea8dbe21-b67b-4967-bf24-920fa95e8d1e tempest-AttachVolumeShelveTestJSON-379407002 None] attachment_update completed successfully.
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:51:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:51:57 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=37,cinder:DELETE=2,cinder:SELECT=30,cinder:INSERT=10 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:51:57 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:52:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (a8d7ae9f-be65-4fde-8d8d-00964d36643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06aba38a-87de-405a-8689-19a16f15f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06aba38a-87de-405a-8689-19a16f15f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-993630599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900076fb-6976-4aec-8fda-27764a9296dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:52:01Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85685f0-8e8e-484b-9b99-454535d02dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85685f0-8e8e-484b-9b99-454535d02dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78210fe3-354f-485d-92d8-96adcc762aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78210fe3-354f-485d-92d8-96adcc762aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900076fb-6976-4aec-8fda-27764a9296dc', 'volume_name': 'volume-900076fb-6976-4aec-8fda-27764a9296dc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd9a597-4fbe-4566-bb63-a48627fb1eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd9a597-4fbe-4566-bb63-a48627fb1eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19cd12-3b19-4748-af3a-e048af9b933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:01 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Volume 900076fb-6976-4aec-8fda-27764a9296dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900076fb-6976-4aec-8fda-27764a9296dc', 'volume_size': 1}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-993630599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900076fb-6976-4aec-8fda-27764a9296dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:52:01Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Creating volume 900076fb-6976-4aec-8fda-27764a9296dc {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:52:01 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:52:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:52:01 devstack quobyte-client[83978]: System call of process 94724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:52:01 devstack quobyte-client[83978]: System call of process 94724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:52:01 devstack quobyte-client[83978]: System call of process 94724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:52:01 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=62, name=volume-900076fb-6976-4aec-8fda-27764a9296dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc 1073741824" returned: 0 in 0.608s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc" returned: 0 in 0.193s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] <== create_volume: return (938ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19cd12-3b19-4748-af3a-e048af9b933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900076fb-6976-4aec-8fda-27764a9296dc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f784096-2d3c-48cf-b54a-3c88dd17e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:52:02 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Volume volume-900076fb-6976-4aec-8fda-27764a9296dc (900076fb-6976-4aec-8fda-27764a9296dc): created successfully
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f784096-2d3c-48cf-b54a-3c88dd17e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:52:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (a8d7ae9f-be65-4fde-8d8d-00964d36643f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:52:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8aea3a0c-6dbd-4a7d-b274-718cb61f0caa tempest-AttachVolumeNegativeTest-1944782245 None] Created volume successfully.
Sep 25 19:52:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:52:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:52:07 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1afd1b-7b5e-4fe5-84ca-1beeefeb29d1]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:52:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:52:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc" returned: 0 in 0.637s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:52:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.712s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:52:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-900076fb-6976-4aec-8fda-27764a9296dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23781edb-7922-41aa-ab74-cf15070a42e9', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:52:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:52:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-ca254300-7d7d-4e9b-af19-28a39e62fefe req-ac2ba5bb-fa16-4d0d-a5b6-3e4668c04a62 tempest-AttachVolumeNegativeTest-1944782245 None] attachment_update completed successfully.
Sep 25 19:52:18 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:52:18 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:52:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-325b989b-5579-43fd-801c-9ef9ad1211fd req-a277b004-93ec-4116-a9c0-0bec86a1e805 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:52:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-325b989b-5579-43fd-801c-9ef9ad1211fd req-a277b004-93ec-4116-a9c0-0bec86a1e805 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:52:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-325b989b-5579-43fd-801c-9ef9ad1211fd req-a277b004-93ec-4116-a9c0-0bec86a1e805 tempest-AttachVolumeNegativeTest-1944782245 None] Terminate volume connection completed successfully.
Sep 25 19:52:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-325b989b-5579-43fd-801c-9ef9ad1211fd req-a277b004-93ec-4116-a9c0-0bec86a1e805 tempest-AttachVolumeNegativeTest-1944782245 None] Deleting attachment 23781edb-7922-41aa-ab74-cf15070a42e9. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:52:47 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:52:47 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.145s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:52:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:53:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:53:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2a59c790-efa9-4417-8af8-00dd1c84b867 req-b934e6fc-e0f2-4904-acaa-a4839baa9106 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:53:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-2a59c790-efa9-4417-8af8-00dd1c84b867 req-b934e6fc-e0f2-4904-acaa-a4839baa9106 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:53:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-2a59c790-efa9-4417-8af8-00dd1c84b867 req-b934e6fc-e0f2-4904-acaa-a4839baa9106 tempest-AttachVolumeShelveTestJSON-379407002 None] Terminate volume connection completed successfully.
Sep 25 19:53:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-2a59c790-efa9-4417-8af8-00dd1c84b867 req-b934e6fc-e0f2-4904-acaa-a4839baa9106 tempest-AttachVolumeShelveTestJSON-379407002 None] Deleting attachment cf379dc5-add7-4569-b923-c423bae6826b. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:53:58 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:54:28 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (93c5052b-0a57-47eb-82cb-d8015d2c209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aaf7d3-fee6-4096-870b-477800e54e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aaf7d3-fee6-4096-870b-477800e54e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2004209209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7caf47-91cd-4373-9114-6f1f82ca9fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:54:28Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ed0ef8-7d1d-4a21-9d53-b061e6fb416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ed0ef8-7d1d-4a21-9d53-b061e6fb416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f171c32-c29d-4cc7-ba36-00b3b2937495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f171c32-c29d-4cc7-ba36-00b3b2937495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7caf47-91cd-4373-9114-6f1f82ca9fbc', 'volume_name': 'volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43cd9f-3c3c-44e2-8c16-1e00277cf79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43cd9f-3c3c-44e2-8c16-1e00277cf79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb588e2-1b52-4105-92cd-b49186b82558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:28 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Volume ca7caf47-91cd-4373-9114-6f1f82ca9fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc', 'volume_size': 1}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2004209209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7caf47-91cd-4373-9114-6f1f82ca9fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3a51e549ce4d7a85b495b293acd6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:54:28Z,use_quota=True,user_id='52203b14b1f74ce1b912b0b51fd68dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Creating volume ca7caf47-91cd-4373-9114-6f1f82ca9fbc {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:54:28 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:54:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:54:28 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=63, name=volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc 1073741824" returned: 0 in 0.634s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" returned: 0 in 0.224s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] <== create_volume: return (1019ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb588e2-1b52-4105-92cd-b49186b82558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bf1a45-c8e4-41b4-84dc-9451f8045b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:54:29 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Volume volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc (ca7caf47-91cd-4373-9114-6f1f82ca9fbc): created successfully
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bf1a45-c8e4-41b4-84dc-9451f8045b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:54:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Flow 'volume_create_manager' (93c5052b-0a57-47eb-82cb-d8015d2c209c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:54:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-dad44d98-eaa6-48bd-8ac1-fd25689dae87 tempest-AttachVolumeNegativeTest-1944782245 None] Created volume successfully.
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ab993-6edb-467c-be21-909b9e4229bb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" returned: 0 in 0.557s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.606s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:54:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e83962d-a23e-4394-a444-1c6bc6f20b8a', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 19:54:34 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:54:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-6cea0aaf-7b70-44a1-832f-93c61f6233f0 req-3d14e364-9678-4a7e-8a25-c47c8ee9d7eb tempest-AttachVolumeNegativeTest-1944782245 None] attachment_update completed successfully.
Sep 25 19:54:44 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:54:45 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:54:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-0ffd48e9-1eac-4a1c-a46e-1cc6cf25075f req-b7e942d7-2b8c-4060-98ae-3067122d2029 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-0ffd48e9-1eac-4a1c-a46e-1cc6cf25075f req-b7e942d7-2b8c-4060-98ae-3067122d2029 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-0ffd48e9-1eac-4a1c-a46e-1cc6cf25075f req-b7e942d7-2b8c-4060-98ae-3067122d2029 tempest-AttachVolumeNegativeTest-1944782245 None] Terminate volume connection completed successfully.
Sep 25 19:55:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-0ffd48e9-1eac-4a1c-a46e-1cc6cf25075f req-b7e942d7-2b8c-4060-98ae-3067122d2029 tempest-AttachVolumeNegativeTest-1944782245 None] Deleting attachment 4e83962d-a23e-4394-a444-1c6bc6f20b8a. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:55:14 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-ca7caf47-91cd-4373-9114-6f1f82ca9fbc-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-ca7caf47-91cd-4373-9114-6f1f82ca9fbc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-quobyte-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b550f-5ec5-421b-a4b4-68b5faf3bd8a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:16 devstack quobyte-client[83978]: System call of process 96515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:16 devstack quobyte-client[83978]: System call of process 96515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:16 devstack quobyte-client[83978]: System call of process 96515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:16 devstack quobyte-client[83978]: System call of process 96515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" returned: 0 in 0.435s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" returned: 0 in 0.099s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-ca7caf47-91cd-4373-9114-6f1f82ca9fbc" released by "delete_volume" :: held 0.735s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:16 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Created reservations ['9f347e90-4504-422f-936c-10a03591f06a', '2e9cf8ea-63c8-450a-b4f8-d7714c0496ac', '685bfe8e-9061-46a4-979f-241848f7f205', 'a4ecb722-445e-4382-8611-f2ddcfaba24b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.142s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Deleted volume successfully.
Sep 25 19:55:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9142228f-bd1b-43ec-a7d8-09d763e8dfc1 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-ca7caf47-91cd-4373-9114-6f1f82ca9fbc-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-900076fb-6976-4aec-8fda-27764a9296dc-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-900076fb-6976-4aec-8fda-27764a9296dc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-quobyte-900076fb-6976-4aec-8fda-27764a9296dc" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-900076fb-6976-4aec-8fda-27764a9296dc" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4fff07-32a1-4abc-930d-113d286af550]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc" returned: 0 in 0.414s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-900076fb-6976-4aec-8fda-27764a9296dc" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-900076fb-6976-4aec-8fda-27764a9296dc" released by "delete_volume" :: held 0.665s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Created reservations ['cb205c19-3ff6-474e-85a9-f8ae963d9447', 'c3847c57-234a-4ce0-b0da-a85de9ea5214', '131ac760-dcd8-4254-bd6b-5db0f06d698e', '5737bc5f-f676-4989-8c58-a2a6dbcebbb0'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Deleted volume successfully.
Sep 25 19:55:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-785a1c5d-b992-4971-833a-6816b46d05f0 tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-900076fb-6976-4aec-8fda-27764a9296dc-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-608f44e5-e57b-4ddb-accf-293e98b77d1f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-608f44e5-e57b-4ddb-accf-293e98b77d1f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:20 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "cinder-quobyte-608f44e5-e57b-4ddb-accf-293e98b77d1f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-608f44e5-e57b-4ddb-accf-293e98b77d1f" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[232feffb-952d-45a7-873a-d7bc0abededb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f" returned: 0 in 0.418s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-608f44e5-e57b-4ddb-accf-293e98b77d1f" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-quobyte-608f44e5-e57b-4ddb-accf-293e98b77d1f" released by "delete_volume" :: held 0.665s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Created reservations ['c49b2b36-4e2c-4b5f-a5b4-96abc6f5a1ef', '85909b4c-3445-446f-94de-8cf738a5f1b6', 'c09615e1-0a1a-4525-ac7f-8f4f161526ba', '00bffcb8-58bd-4b44-980e-743f53142a0e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.114s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:22 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Deleted volume successfully.
Sep 25 19:55:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-77760e88-5110-4c7d-abe0-9b64bebc821b tempest-AttachVolumeNegativeTest-1944782245 None] Lock "cinder-608f44e5-e57b-4ddb-accf-293e98b77d1f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Flow 'volume_create_manager' (6ab72992-5e0b-4f68-bdf1-4d04f6a6f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dc77cc-ef69-47f1-a8cf-3c07e7ca3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dc77cc-ef69-47f1-a8cf-3c07e7ca3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1982514770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a85d32-a83f-4cd8-af1b-534e3304c6a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c5586277b12403e8b0a280eddeae03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:30Z,use_quota=True,user_id='28268d7e8ded4101a8241641d5265c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf5faa7-237e-4d25-b95c-27f39c8f9af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf5faa7-237e-4d25-b95c-27f39c8f9af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bedeff8-af8a-4464-847c-e4d482f5e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bedeff8-af8a-4464-847c-e4d482f5e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a85d32-a83f-4cd8-af1b-534e3304c6a4', 'volume_name': 'volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4a2663-4700-4b3e-b918-1e448b8ba08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4a2663-4700-4b3e-b918-1e448b8ba08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95a2d19-9cdb-4a98-89ba-c355d99e2508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Volume 32a85d32-a83f-4cd8-af1b-534e3304c6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4', 'volume_size': 1}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1982514770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a85d32-a83f-4cd8-af1b-534e3304c6a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c5586277b12403e8b0a280eddeae03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:30Z,use_quota=True,user_id='28268d7e8ded4101a8241641d5265c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Creating volume 32a85d32-a83f-4cd8-af1b-534e3304c6a4 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:55:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:30 devstack quobyte-client[83978]: System call of process 96619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:30 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=64, name=volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 1073741824" returned: 0 in 0.330s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4" returned: 0 in 0.078s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:55:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.481s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95a2d19-9cdb-4a98-89ba-c355d99e2508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3caa65f-3e3e-4e25-8311-f140ef8893bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:31 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Volume volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 (32a85d32-a83f-4cd8-af1b-534e3304c6a4): created successfully
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3caa65f-3e3e-4e25-8311-f140ef8893bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Flow 'volume_create_manager' (6ab72992-5e0b-4f68-bdf1-4d04f6a6f63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:31 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-fb3e9ab5-fd3e-4508-a066-6852966040c8 req-836c83cd-87a8-4009-9603-c5e7680a87f6 tempest-VolumesGetTestJSON-1416910814 None] Created volume successfully.
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Acquiring lock "cinder-32a85d32-a83f-4cd8-af1b-534e3304c6a4-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "cinder-32a85d32-a83f-4cd8-af1b-534e3304c6a4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Acquiring lock "cinder-quobyte-32a85d32-a83f-4cd8-af1b-534e3304c6a4" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "cinder-quobyte-32a85d32-a83f-4cd8-af1b-534e3304c6a4" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86e742-36b6-43f3-a4ec-150f71bd9da4]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4" returned: 0 in 0.382s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-32a85d32-a83f-4cd8-af1b-534e3304c6a4" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "cinder-quobyte-32a85d32-a83f-4cd8-af1b-534e3304c6a4" released by "delete_volume" :: held 0.620s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG cinder.quota [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Created reservations ['15442795-a4ac-4954-b04a-f70cb63e1658', '8b5f91f0-508c-488c-b04f-b5eb09be3176', '60b16de3-d694-4000-b12b-e82c143351bd', '49d1b1f0-63ba-41f8-88bc-7ae4c448b317'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:32 devstack cinder-volume[83952]: DEBUG cinder.manager [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Deleted volume successfully.
Sep 25 19:55:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-02032c9f-aa5f-4d4c-90eb-977293cd186d req-30054485-f7ca-4492-986a-4975bcedb193 tempest-VolumesGetTestJSON-1416910814 None] Lock "cinder-32a85d32-a83f-4cd8-af1b-534e3304c6a4-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:33 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:55:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Flow 'volume_create_manager' (276a8a45-d3ff-4005-bfc7-1266ee0b87c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f5617a-52c4-4366-98d0-9b16c3735623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f5617a-52c4-4366-98d0-9b16c3735623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-376366391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e224b59545b42608c334de282e080d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:34Z,use_quota=True,user_id='25e6035560ab4f1e9e14e6760646e210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866f8d8-2bff-4058-a257-05e71c649421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866f8d8-2bff-4058-a257-05e71c649421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd195bbf-0795-4386-ad95-d1e4c049e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd195bbf-0795-4386-ad95-d1e4c049e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3', 'volume_name': 'volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f970ce-919f-487e-bc81-d4de97251ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f970ce-919f-487e-bc81-d4de97251ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1f574-d999-467f-b6e8-b53181077615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume 5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3', 'volume_size': 1}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-376366391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e224b59545b42608c334de282e080d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:34Z,use_quota=True,user_id='25e6035560ab4f1e9e14e6760646e210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Creating volume 5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:55:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:34 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=65, name=volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 1073741824" returned: 0 in 0.388s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" returned: 0 in 0.110s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] <== create_volume: return (568ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1f574-d999-467f-b6e8-b53181077615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b9ddee-0c10-455f-a929-5f0476e4020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 (5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3): created successfully
Sep 25 19:55:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b9ddee-0c10-455f-a929-5f0476e4020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Flow 'volume_create_manager' (276a8a45-d3ff-4005-bfc7-1266ee0b87c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a3ac26f5-d0a6-47c6-ba24-e04d21738041 tempest-AttachVolumeShelveTestJSON-379407002 None] Created volume successfully.
Sep 25 19:55:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-79b41ede-32de-406b-8c5b-607a49a8a299 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-79b41ede-32de-406b-8c5b-607a49a8a299 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-1654118079: creating
Sep 25 19:55:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-79b41ede-32de-406b-8c5b-607a49a8a299 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-1654118079: created successfully
Sep 25 19:55:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-79b41ede-32de-406b-8c5b-607a49a8a299 tempest-GroupSnapshotsTest-982021779 None] Create group completed successfully.
Sep 25 19:55:40 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (8c4ea5b4-e804-4651-b275-58b02bc945bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab8efa-f4e5-4a76-8ab5-6f9536381d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab8efa-f4e5-4a76-8ab5-6f9536381d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361313877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f49940d9-efb2-4730-b615-edc3166760c6,host='devstack@QuobyteHD#QuobyteHD',id=535283ae-8ec3-4922-b6d8-50c90ea7dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:40Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e16e2b7-f7ca-4f32-861c-dc6936617a2a),volume_type_id=3e16e2b7-f7ca-4f32-861c-dc6936617a2a)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0d589f-10ca-444e-8328-d1138d1bd0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0d589f-10ca-444e-8328-d1138d1bd0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138c466-7112-4a41-8278-d237248e3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138c466-7112-4a41-8278-d237248e3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535283ae-8ec3-4922-b6d8-50c90ea7dd38', 'volume_name': 'volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdcd749-3b70-4227-be22-27d9e26de226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdcd749-3b70-4227-be22-27d9e26de226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758cf08a-fe49-4745-8a8f-11ab92352f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:40 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Volume 535283ae-8ec3-4922-b6d8-50c90ea7dd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38', 'volume_size': 1}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f49940d9-efb2-4730-b615-edc3166760c6,created_at=2025-09-25T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361313877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f49940d9-efb2-4730-b615-edc3166760c6,host='devstack@QuobyteHD#QuobyteHD',id=535283ae-8ec3-4922-b6d8-50c90ea7dd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:55:40Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e16e2b7-f7ca-4f32-861c-dc6936617a2a),volume_type_id=3e16e2b7-f7ca-4f32-861c-dc6936617a2a)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Creating volume 535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:55:40 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:55:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:40 devstack quobyte-client[83978]: System call of process 96711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:40 devstack quobyte-client[83978]: System call of process 96711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:41 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=66, name=volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 1073741824" returned: 0 in 0.394s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] <== create_volume: return (610ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758cf08a-fe49-4745-8a8f-11ab92352f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adac4a2-874c-496c-abfe-32b2f292e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:55:41 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Volume volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 (535283ae-8ec3-4922-b6d8-50c90ea7dd38): created successfully
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adac4a2-874c-496c-abfe-32b2f292e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:55:41 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (8c4ea5b4-e804-4651-b275-58b02bc945bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:55:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-46aa9d9c-2832-4668-b037-d475eb021af7 tempest-GroupSnapshotsTest-982021779 None] Created volume successfully.
Sep 25 19:55:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] GroupSnapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: creating.
Sep 25 19:55:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Group snapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: creating. {{(pid=83952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Creating offline snapshot 17efe128-97a9-4ebc-9d95-7847b93d3870 of volume 535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ed748-5395-443c-9ced-b003a63702fe]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:43 devstack quobyte-client[83978]: System call of process 96720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.889s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:43 devstack quobyte-client[83978]: System call of process 96732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:43 devstack quobyte-client[83978]: System call of process 96732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:43 devstack quobyte-client[83978]: System call of process 96732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:43 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=67, name=volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:55:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 1G" returned: 0 in 0.328s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img rebase -u -b volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:44 devstack quobyte-client[83978]: System call of process 96735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img rebase -u -b volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.207s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.140s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.161s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.info" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.info" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-914a8728-b10d-4058-a9e2-692af7c565ca tempest-GroupSnapshotsTest-982021779 None] group_snapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: created successfully
Sep 25 19:55:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870-958b3046-fe05-4258-a111-d8e10bed6434" by "_create_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870-958b3046-fe05-4258-a111-d8e10bed6434" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Creating volume 958b3046-fe05-4258-a111-d8e10bed6434 from snapshot 17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" by "_copy_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] snapshot: 17efe128-97a9-4ebc-9d95-7847b93d3870, volume: 958b3046-fe05-4258-a111-d8e10bed6434,  {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83ea6ec-a1e0-48f6-9ab1-00c593abcb1e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:47 devstack quobyte-client[83978]: System call of process 96745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:47 devstack quobyte-client[83978]: System call of process 96745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:47 devstack quobyte-client[83978]: System call of process 96745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.734s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Creating direct copy from snapshot {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad93a0c-e5bc-4d8c-ad22-d95aa81365af]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.402s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:48 devstack cinder-volume[83952]: DEBUG cinder.utils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 not found in is_blk_device check {{(pid=83952) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 25 19:55:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:48 devstack quobyte-client[83978]: System call of process 96758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:48 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=69, name=volume-958b3046-fe05-4258-a111-d8e10bed6434, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434" returned: 0 in 5.740s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e497121-8c89-4b8f-ae04-9489e71095cf]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.720s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 19:55:54 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Converted 1024.00 MB image at 177.68 MB/s
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:55:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434" returned: 0 in 0.076s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870-958b3046-fe05-4258-a111-d8e10bed6434" released by "_create_volume_from_snapshot" :: held 8.069s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.140s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6e7edd2b-9488-43e9-8da0-db8066dfb6d4 tempest-GroupSnapshotsTest-982021779 None] Create group from source-snapshot-6f5fc786-8c48-4783-9445-ba38de4885f3 completed successfully.
Sep 25 19:55:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c32aae-b7d9-4ca8-9766-59c988bd009c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434" returned: 0 in 0.418s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-958b3046-fe05-4258-a111-d8e10bed6434" returned: 0 in 0.111s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-958b3046-fe05-4258-a111-d8e10bed6434" released by "delete_volume" :: held 0.712s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['536b6f06-d49c-4da3-9860-f500030c735b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-7752e2e6-fc48-4cd8-aea0-42d6b1519f5f req-5ec1b806-6369-4de8-a772-09a03c886e86 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:58 devstack cinder-volume[83952]: WARNING cinder.quota [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-120818551 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-120818551, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:55:58 devstack cinder-volume[83952]: WARNING cinder.quota [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-120818551 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-120818551, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:55:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-7752e2e6-fc48-4cd8-aea0-42d6b1519f5f req-5ec1b806-6369-4de8-a772-09a03c886e86 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-7752e2e6-fc48-4cd8-aea0-42d6b1519f5f req-5ec1b806-6369-4de8-a772-09a03c886e86 tempest-AttachVolumeShelveTestJSON-379407002 None] No connector for attachment 3b9ee8e7-0b12-4821-8c28-c62b287dddff; skipping storage backend terminate_connection call. {{(pid=83952) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-7752e2e6-fc48-4cd8-aea0-42d6b1519f5f req-5ec1b806-6369-4de8-a772-09a03c886e86 tempest-AttachVolumeShelveTestJSON-379407002 None] Deleting attachment 3b9ee8e7-0b12-4821-8c28-c62b287dddff. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['fd176484-8bae-4523-a753-a8eb4d0d971f', 'c5020bc6-1ea5-4d33-b7a5-f4ec15ff33db', '42106f75-a367-4818-89c8-915fb2518334', 'a4b3af6e-fc88-4bc1-bcd8-f070ed9a1b25'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:58 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:55:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4c26caf7-cf70-489c-8d47-1e34ebc8ed89 tempest-GroupSnapshotsTest-982021779 None] Delete group completed successfully.
Sep 25 19:55:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] group_snapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: deleting
Sep 25 19:55:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] group_snapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: deleting {{(pid=83952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Deleting offline snapshot 17efe128-97a9-4ebc-9d95-7847b93d3870 of volume 535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] snapshot_file for this snap is: volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103e491-f6d4-4157-9f56-1c38d7208277]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:55:59 devstack quobyte-client[83978]: System call of process 96794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:59 devstack quobyte-client[83978]: System call of process 96794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.413s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:55:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd46365-dc12-484f-8a30-bfc75a59358c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:00 devstack quobyte-client[83978]: System call of process 96797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:00 devstack quobyte-client[83978]: System call of process 96797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:00 devstack quobyte-client[83978]: System call of process 96797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.496s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:00 devstack quobyte-client[83978]: System call of process 96801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.226s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38.17efe128-97a9-4ebc-9d95-7847b93d3870" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-17efe128-97a9-4ebc-9d95-7847b93d3870" released by "_delete_snapshot" :: held 1.500s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" released by "delete_snapshot" :: held 1.524s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:01 devstack cinder-volume[83952]: WARNING cinder.quota [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-120818551 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-120818551, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] Created reservations ['51928016-8e06-4340-bac1-166345439674', '93b7853a-576c-48a1-b079-e054abeb941b', '3eeaaa05-cb86-4f46-a6da-53b4df2f77cd', 'cd2d30ae-1884-4423-bc9e-685e894f0fdb'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e96aacb1-44cb-44b9-adf1-4061670f6cfd tempest-GroupSnapshotsTest-982021779 None] group_snapshot 6f5fc786-8c48-4783-9445-ba38de4885f3: deleted successfully
Sep 25 19:56:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:02 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824d81b-e6cc-4f7e-9e96-fc92180441fa]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.411s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-535283ae-8ec3-4922-b6d8-50c90ea7dd38" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-535283ae-8ec3-4922-b6d8-50c90ea7dd38" released by "delete_volume" :: held 0.687s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['1b1b6d86-a066-4cdb-bcb7-12937fee3003'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:03 devstack cinder-volume[83952]: WARNING cinder.db.sqlalchemy.api [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-120818551']
Sep 25 19:56:03 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['6be820c6-c539-4c1f-9f7e-0fed29068c39', 'f4fab854-6e5b-4fdc-8b7d-a1c309c2631b', 'b44f7ff9-df5d-4b7e-9fd6-ee44ef4c5604', '877595ff-160f-4bb0-9b63-980c369aa98d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.099s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:04 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3f36f612-8d2a-40fc-a113-2d3aaeab5f13 tempest-GroupSnapshotsTest-982021779 None] Delete group completed successfully.
Sep 25 19:56:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-849a8798-f47e-44bc-b266-334524407b94 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:06 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-849a8798-f47e-44bc-b266-334524407b94 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-1934306603: creating
Sep 25 19:56:06 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-849a8798-f47e-44bc-b266-334524407b94 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-1934306603: created successfully
Sep 25 19:56:06 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-849a8798-f47e-44bc-b266-334524407b94 tempest-GroupSnapshotsTest-982021779 None] Create group completed successfully.
Sep 25 19:56:07 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (aa1caf70-bf80-465d-953a-65fcb660625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dc56d4-ec67-484d-859b-c7d4d09f07d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dc56d4-ec67-484d-859b-c7d4d09f07d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730800959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,host='devstack@QuobyteHD#QuobyteHD',id=4c220843-ecd6-45e3-90af-0f4976675831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:08Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(441661d4-d0b4-46ac-a6b1-b0a80b340d5b),volume_type_id=441661d4-d0b4-46ac-a6b1-b0a80b340d5b)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a3c32-dc21-4cf1-9e52-52e2365dc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a3c32-dc21-4cf1-9e52-52e2365dc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e1d41c-bb75-43ea-9bc3-5406a4f373ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e1d41c-bb75-43ea-9bc3-5406a4f373ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c220843-ecd6-45e3-90af-0f4976675831', 'volume_name': 'volume-4c220843-ecd6-45e3-90af-0f4976675831', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b3f3c3-b73d-46af-924c-b1bd1a3aed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b3f3c3-b73d-46af-924c-b1bd1a3aed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c09ce1b-9848-4b6b-b03a-402846f07ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Volume 4c220843-ecd6-45e3-90af-0f4976675831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c220843-ecd6-45e3-90af-0f4976675831', 'volume_size': 1}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,created_at=2025-09-25T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-730800959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,host='devstack@QuobyteHD#QuobyteHD',id=4c220843-ecd6-45e3-90af-0f4976675831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:08Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(441661d4-d0b4-46ac-a6b1-b0a80b340d5b),volume_type_id=441661d4-d0b4-46ac-a6b1-b0a80b340d5b)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Creating volume 4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:56:07 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:56:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:07 devstack quobyte-client[83978]: System call of process 96812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:07 devstack quobyte-client[83978]: System call of process 96812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:07 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=70, name=volume-4c220843-ecd6-45e3-90af-0f4976675831, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 1073741824" returned: 0 in 0.347s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] <== create_volume: return (522ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c09ce1b-9848-4b6b-b03a-402846f07ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c220843-ecd6-45e3-90af-0f4976675831', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d6e840-4719-4ebd-b7b8-54df8fc325b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:08 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Volume volume-4c220843-ecd6-45e3-90af-0f4976675831 (4c220843-ecd6-45e3-90af-0f4976675831): created successfully
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d6e840-4719-4ebd-b7b8-54df8fc325b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (aa1caf70-bf80-465d-953a-65fcb660625e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9b8126d3-ac28-4c63-8b99-565198a3c875 tempest-GroupSnapshotsTest-982021779 None] Created volume successfully.
Sep 25 19:56:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (e55e4eb4-6ab3-4902-a280-4524fdff0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4018e1-220f-4296-92ec-91df301084d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4018e1-220f-4296-92ec-91df301084d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525313024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,host='devstack@QuobyteHD#QuobyteHD',id=c529bd4d-182c-47d3-a6e6-499d11f0a03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:10Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(441661d4-d0b4-46ac-a6b1-b0a80b340d5b),volume_type_id=441661d4-d0b4-46ac-a6b1-b0a80b340d5b)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db6bb9-85e2-4860-b95d-b6a4a2830891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db6bb9-85e2-4860-b95d-b6a4a2830891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e19b0f-c5c5-49f0-b16c-cf50c8fcc745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e19b0f-c5c5-49f0-b16c-cf50c8fcc745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c529bd4d-182c-47d3-a6e6-499d11f0a03f', 'volume_name': 'volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833aa76c-8d64-4294-b4ec-2045da062874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833aa76c-8d64-4294-b4ec-2045da062874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8b8e7-b7ad-4650-b1f0-1ec1cdef9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:10 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Volume c529bd4d-182c-47d3-a6e6-499d11f0a03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f', 'volume_size': 1}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,created_at=2025-09-25T17:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525313024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a3456a5-58f4-4fa1-b9c6-441e533324e2,host='devstack@QuobyteHD#QuobyteHD',id=c529bd4d-182c-47d3-a6e6-499d11f0a03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:10Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(441661d4-d0b4-46ac-a6b1-b0a80b340d5b),volume_type_id=441661d4-d0b4-46ac-a6b1-b0a80b340d5b)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Creating volume c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:56:10 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:56:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:10 devstack quobyte-client[83978]: System call of process 96819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:10 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=71, name=volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f 1073741824" returned: 0 in 0.560s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8b8e7-b7ad-4650-b1f0-1ec1cdef9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bde355e-0293-4e08-bbb6-75edcb23962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:11 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Volume volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f (c529bd4d-182c-47d3-a6e6-499d11f0a03f): created successfully
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bde355e-0293-4e08-bbb6-75edcb23962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (e55e4eb4-6ab3-4902-a280-4524fdff0f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:11 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8f8c4587-accc-4587-b3d3-c0e9d95aef7f tempest-GroupSnapshotsTest-982021779 None] Created volume successfully.
Sep 25 19:56:12 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-261fc3da-31c3-46a5-bbac-7e50a51de395 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-261fc3da-31c3-46a5-bbac-7e50a51de395 tempest-GroupSnapshotsTest-982021779 None] Update group completed successfully.
Sep 25 19:56:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9db9cd56-68c8-4766-82ec-baee1b379e45 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9db9cd56-68c8-4766-82ec-baee1b379e45 tempest-GroupSnapshotsTest-982021779 None] Update group completed successfully.
Sep 25 19:56:15 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=66,cinder:INSERT=13,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:56:15 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=86,cinder:SELECT=73,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:56:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-050bc94c-89f0-4c7e-bc50-b5a1ff295ba7 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-050bc94c-89f0-4c7e-bc50-b5a1ff295ba7 tempest-GroupSnapshotsTest-982021779 None] Update group completed successfully.
Sep 25 19:56:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a1a3a101-69a6-426b-bda7-92ecbfbaafec tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:16 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a1a3a101-69a6-426b-bda7-92ecbfbaafec tempest-GroupSnapshotsTest-982021779 None] Update group completed successfully.
Sep 25 19:56:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] GroupSnapshot 79d02252-3851-4b36-8e84-1979ec083b56: creating.
Sep 25 19:56:17 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Group snapshot 79d02252-3851-4b36-8e84-1979ec083b56: creating. {{(pid=83952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Creating offline snapshot 47b16158-28c1-4313-93c4-4e5bfef1c024 of volume c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c593d58-48ac-4060-b581-57b2dd299c89]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:18 devstack quobyte-client[83978]: System call of process 96852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f" returned: 0 in 0.529s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:18 devstack quobyte-client[83978]: System call of process 96855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:18 devstack quobyte-client[83978]: System call of process 96855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:18 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=72, name=volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 1G" returned: 0 in 0.342s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img rebase -u -b volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.145s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.080s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.080s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.info" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.info" returned: 0 in 0.109s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.766s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Creating offline snapshot f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 of volume 4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa403fe-fcb0-4a43-8b7a-354fe9dc5285]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831" returned: 0 in 0.514s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:20 devstack quobyte-client[83978]: System call of process 96871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:20 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=74, name=volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 1G" returned: 0 in 0.221s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4c220843-ecd6-45e3-90af-0f4976675831 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img rebase -u -b volume-4c220843-ecd6-45e3-90af-0f4976675831 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.140s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.094s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.info" returned: 0 in 0.088s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.info" returned: 0 in 0.085s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.703s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3e28d998-2584-404e-82b7-a65697bc906a tempest-GroupSnapshotsTest-982021779 None] group_snapshot 79d02252-3851-4b36-8e84-1979ec083b56: created successfully
Sep 25 19:56:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] group_snapshot 79d02252-3851-4b36-8e84-1979ec083b56: deleting
Sep 25 19:56:22 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] group_snapshot 79d02252-3851-4b36-8e84-1979ec083b56: deleting {{(pid=83952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" acquired by "delete_snapshot" :: waited 0.076s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-47b16158-28c1-4313-93c4-4e5bfef1c024" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-47b16158-28c1-4313-93c4-4e5bfef1c024" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Deleting offline snapshot 47b16158-28c1-4313-93c4-4e5bfef1c024 of volume c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] snapshot_file for this snap is: volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd72f2-40b7-4a23-947b-0bfc6ae62846]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:23 devstack quobyte-client[83978]: System call of process 96887 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.456s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77775e-6c65-43dc-8e3d-e6da3bc73b92]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:23 devstack quobyte-client[83978]: System call of process 96894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f" returned: 0 in 0.488s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:23 devstack quobyte-client[83978]: System call of process 96901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.246s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f.47b16158-28c1-4313-93c4-4e5bfef1c024" returned: 0 in 0.102s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-47b16158-28c1-4313-93c4-4e5bfef1c024" released by "_delete_snapshot" :: held 1.953s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" released by "delete_snapshot" :: held 1.993s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Deleting offline snapshot f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 of volume 4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] snapshot_file for this snap is: volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8734f-4c88-42f2-baac-327f3d42798c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:26 devstack quobyte-client[83978]: System call of process 96933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:26 devstack quobyte-client[83978]: System call of process 96933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.947s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c220843-ecd6-45e3-90af-0f4976675831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:56:26 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ffc11-edc4-4eb3-9506-1a0839045096]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:27 devstack quobyte-client[83978]: System call of process 96956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:27 devstack quobyte-client[83978]: System call of process 96956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:27 devstack quobyte-client[83978]: System call of process 96956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831" returned: 0 in 0.781s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.311s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831.f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" returned: 0 in 0.138s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-f5e1e1a9-6f5d-40a0-a67c-5952427e3e07" released by "_delete_snapshot" :: held 2.724s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" released by "delete_snapshot" :: held 2.772s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:28 devstack cinder-volume[83952]: WARNING cinder.quota [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1710555023 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1710555023, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:28 devstack cinder-volume[83952]: WARNING cinder.quota [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1710555023 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1710555023, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:28 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['30fe87a0-036b-4289-b617-ebe03f2d0dc9', '46ede005-03fa-4f91-98bf-41975889eaa2', '1aa4bb80-f932-483c-8f78-1fcaf52edeb7', 'ffc60e0c-c6cd-446a-a086-8dc817dd5114'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:28 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['7218acbd-af33-4d71-bf39-cfe041411eed', 'f59e7f7e-6d26-41f3-bb3a-321890a06223', '2683ea6d-5942-4521-9f8e-8ca1f3be02a3', 'd8ed9429-7891-4f01-ae25-c250a3c08d61'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:28 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-60b29d2a-1b4b-4150-b290-ea2f767bfef9 tempest-GroupSnapshotsTest-982021779 None] group_snapshot 79d02252-3851-4b36-8e84-1979ec083b56: deleted successfully
Sep 25 19:56:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" acquired by "delete_volume" :: waited 0.024s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4b5b3-65e2-4e7c-a234-738c7d195d0e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831" returned: 0 in 0.444s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4c220843-ecd6-45e3-90af-0f4976675831" returned: 0 in 0.102s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-4c220843-ecd6-45e3-90af-0f4976675831" released by "delete_volume" :: held 0.715s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b22ecc-5ff9-4f9d-b203-b3434eaaf14d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:30 devstack quobyte-client[83978]: System call of process 96983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f" returned: 0 in 0.547s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c529bd4d-182c-47d3-a6e6-499d11f0a03f" returned: 0 in 0.131s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-c529bd4d-182c-47d3-a6e6-499d11f0a03f" released by "delete_volume" :: held 0.922s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['12e174e8-e1ca-4898-b6d1-430ab415f243'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:31 devstack cinder-volume[83952]: WARNING cinder.quota [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1710555023 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1710555023, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['9f222b46-5400-4c1f-8605-a16d3755806a', 'b43928f7-d366-4b69-9383-8ef166557b7d', '37a426a2-443b-4a07-8ca0-af108923edca', 'bdb51ebc-0345-4449-99cb-a514c9a9e11d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['29b1e3fc-1a1c-40e5-bbc1-9f401a5c7102', 'e041df7c-1a4e-4d36-8705-14c48d3d0943', '179ae0e0-06e0-466d-a5c2-7a633fdea311', '7483f204-b0ba-48ca-a15b-ee1564395ff2'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.140s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:32 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c00ca887-d978-450d-89b8-1fd018de2c58 tempest-GroupSnapshotsTest-982021779 None] Delete group completed successfully.
Sep 25 19:56:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-68ec573c-df5b-4fb0-8a18-a46f34ed0d30 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-68ec573c-df5b-4fb0-8a18-a46f34ed0d30 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-664558458: creating
Sep 25 19:56:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-68ec573c-df5b-4fb0-8a18-a46f34ed0d30 tempest-GroupSnapshotsTest-982021779 None] Group tempest-GroupSnapshotsTest-Group-664558458: created successfully
Sep 25 19:56:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-68ec573c-df5b-4fb0-8a18-a46f34ed0d30 tempest-GroupSnapshotsTest-982021779 None] Create group completed successfully.
Sep 25 19:56:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (81c0a5e5-54d9-4ca5-be05-c341055d86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aebbaf-462a-44bf-8e23-654eb0d7b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aebbaf-462a-44bf-8e23-654eb0d7b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-111752831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24d80742-88c3-42f7-8358-f36e802d1b69,host='devstack@QuobyteHD#QuobyteHD',id=deb889f5-a66d-4208-bede-c94d3ceb1eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:35Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84c6ce7-4d98-41ab-ab02-8b07d6a1df11),volume_type_id=e84c6ce7-4d98-41ab-ab02-8b07d6a1df11)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcbc10c-d15b-4de4-a910-f9dc910350c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcbc10c-d15b-4de4-a910-f9dc910350c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993bef11-9be1-4181-b6f7-13de2280981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993bef11-9be1-4181-b6f7-13de2280981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb889f5-a66d-4208-bede-c94d3ceb1eda', 'volume_name': 'volume-deb889f5-a66d-4208-bede-c94d3ceb1eda', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85440bcb-13cc-4631-b772-216b0ace4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85440bcb-13cc-4631-b772-216b0ace4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c74d803-9c88-4787-8ac2-9c840adfd3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Volume deb889f5-a66d-4208-bede-c94d3ceb1eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb889f5-a66d-4208-bede-c94d3ceb1eda', 'volume_size': 1}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=24d80742-88c3-42f7-8358-f36e802d1b69,created_at=2025-09-25T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-111752831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24d80742-88c3-42f7-8358-f36e802d1b69,host='devstack@QuobyteHD#QuobyteHD',id=deb889f5-a66d-4208-bede-c94d3ceb1eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b78358779145108a523f0d31cfcbf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:35Z,use_quota=True,user_id='961625b2bf164a2892ded62f0ec41434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84c6ce7-4d98-41ab-ab02-8b07d6a1df11),volume_type_id=e84c6ce7-4d98-41ab-ab02-8b07d6a1df11)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Creating volume deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:56:35 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:35 devstack quobyte-client[83978]: System call of process 96989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=76, name=volume-deb889f5-a66d-4208-bede-c94d3ceb1eda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda 1073741824" returned: 0 in 0.399s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda" returned: 0 in 0.081s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] <== create_volume: return (541ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c74d803-9c88-4787-8ac2-9c840adfd3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb889f5-a66d-4208-bede-c94d3ceb1eda', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b0b814-1f77-4bc4-ba57-d600d6ea4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Volume volume-deb889f5-a66d-4208-bede-c94d3ceb1eda (deb889f5-a66d-4208-bede-c94d3ceb1eda): created successfully
Sep 25 19:56:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b0b814-1f77-4bc4-ba57-d600d6ea4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Flow 'volume_create_manager' (81c0a5e5-54d9-4ca5-be05-c341055d86d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fadc6dae-4e78-4664-80d0-93c4075e7a70 tempest-GroupSnapshotsTest-982021779 None] Created volume successfully.
Sep 25 19:56:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] GroupSnapshot dd52a05d-e39e-44a4-81e2-220d3236771d: creating.
Sep 25 19:56:36 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Group snapshot dd52a05d-e39e-44a4-81e2-220d3236771d: creating. {{(pid=83952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Creating offline snapshot 8d92c767-fa86-4363-9f4b-dec9071ca49b of volume deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[db36bca9-6262-4ac0-b2fc-930c5f6896ce]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:36 devstack quobyte-client[83978]: System call of process 96995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda" returned: 0 in 0.406s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack quobyte-client[83978]: System call of process 96998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:37 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=77, name=volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b 1G" returned: 0 in 0.236s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img rebase -u -b volume-deb889f5-a66d-4208-bede-c94d3ceb1eda -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack quobyte-client[83978]: System call of process 97001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img rebase -u -b volume-deb889f5-a66d-4208-bede-c94d3ceb1eda -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.141s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.090s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.info" returned: 0 in 0.090s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.info" returned: 0 in 0.079s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.505s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:38 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9b255266-bf60-46d6-8398-f80b76d6f3e1 tempest-GroupSnapshotsTest-982021779 None] group_snapshot dd52a05d-e39e-44a4-81e2-220d3236771d: created successfully
Sep 25 19:56:38 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] group_snapshot dd52a05d-e39e-44a4-81e2-220d3236771d: deleting
Sep 25 19:56:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] group_snapshot dd52a05d-e39e-44a4-81e2-220d3236771d: deleting {{(pid=83952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" acquired by "delete_snapshot" :: waited 0.070s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-8d92c767-fa86-4363-9f4b-dec9071ca49b" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-8d92c767-fa86-4363-9f4b-dec9071ca49b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Deleting offline snapshot 8d92c767-fa86-4363-9f4b-dec9071ca49b of volume deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] snapshot_file for this snap is: volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce8186b-01c7-4c54-97c7-d21af6cb6002]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:39 devstack quobyte-client[83978]: System call of process 97008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:39 devstack quobyte-client[83978]: System call of process 97008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:39 devstack quobyte-client[83978]: System call of process 97008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.378s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb889f5-a66d-4208-bede-c94d3ceb1eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700b989-f787-47e0-89e8-e18153baeb82]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda" returned: 0 in 0.387s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:39 devstack quobyte-client[83978]: System call of process 97014 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.242s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda.8d92c767-fa86-4363-9f4b-dec9071ca49b" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-8d92c767-fa86-4363-9f4b-dec9071ca49b" released by "_delete_snapshot" :: held 1.410s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" released by "delete_snapshot" :: held 1.451s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:40 devstack cinder-volume[83952]: WARNING cinder.quota [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-718832744 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-718832744, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:40 devstack cinder-volume[83952]: WARNING cinder.quota [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-718832744 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-718832744, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:40 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] Created reservations ['54c8d018-6c7e-4950-a23c-549b169688ee', '347f9848-86c8-4914-b4b7-754db10ea050', '5a07d4d0-f488-4487-a6cf-ebaf86bbce27', '7aee8211-f610-43ee-b0ba-ea7991d25460'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0a1ca599-417a-4b25-a47a-4eeca624082b tempest-GroupSnapshotsTest-982021779 None] group_snapshot dd52a05d-e39e-44a4-81e2-220d3236771d: deleted successfully
Sep 25 19:56:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad92c6e-33a0-4bdc-97b8-533d75c68097]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:42 devstack quobyte-client[83978]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:42 devstack quobyte-client[83978]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:42 devstack quobyte-client[83978]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:42 devstack quobyte-client[83978]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:42 devstack quobyte-client[83978]: System call of process 97049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda" returned: 0 in 0.627s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-deb889f5-a66d-4208-bede-c94d3ceb1eda" returned: 0 in 0.129s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Lock "cinder-quobyte-deb889f5-a66d-4208-bede-c94d3ceb1eda" released by "delete_volume" :: held 1.015s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['bca86b86-4828-43a5-b34a-6fbe229e20b0'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:43 devstack cinder-volume[83952]: WARNING cinder.quota [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-718832744 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-718832744, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Created reservations ['13efc1a5-2db2-4054-8a19-1afec62af84d', 'e8fc2471-ce93-4e09-8637-63a715659f30', 'a7b4ae4a-c8fd-484c-b7af-ad2b4d7b7112', '149a2aad-73aa-40aa-8cad-f39716cb4931'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.270s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:44 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ffe049f7-feda-4b51-9bb3-2e18e26963a2 tempest-GroupSnapshotsTest-982021779 None] Delete group completed successfully.
Sep 25 19:56:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6d8da461-52a2-44fa-939d-575c89605f87 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d8da461-52a2-44fa-939d-575c89605f87 tempest-GroupsTest-820100513 None] Group tempest-Group1-2097159553: creating
Sep 25 19:56:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d8da461-52a2-44fa-939d-575c89605f87 tempest-GroupsTest-820100513 None] Group tempest-Group1-2097159553: created successfully
Sep 25 19:56:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6d8da461-52a2-44fa-939d-575c89605f87 tempest-GroupsTest-820100513 None] Create group completed successfully.
Sep 25 19:56:51 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-29ca4bf4-d901-4ae1-9451-84c1ee6cf162 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-29ca4bf4-d901-4ae1-9451-84c1ee6cf162 tempest-GroupsTest-820100513 None] Group tempest-Group2-202970633: creating
Sep 25 19:56:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-29ca4bf4-d901-4ae1-9451-84c1ee6cf162 tempest-GroupsTest-820100513 None] Group tempest-Group2-202970633: created successfully
Sep 25 19:56:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-29ca4bf4-d901-4ae1-9451-84c1ee6cf162 tempest-GroupsTest-820100513 None] Create group completed successfully.
Sep 25 19:56:52 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:52 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:56:52 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (ff9019a5-0f5b-4db8-9a10-43ddac9a574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8f5395-49c6-4a6e-ae67-954d7acac8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8f5395-49c6-4a6e-ae67-954d7acac8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-242473801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5669512e-bf1b-4086-91a3-5b6b58525ba0,host='devstack@QuobyteHD#QuobyteHD',id=c576a971-cb61-417c-a28f-f5b1d34cfd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:53Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd756e6-11b4-412b-a0e2-9ab1ce196a40),volume_type_id=dfd756e6-11b4-412b-a0e2-9ab1ce196a40)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2846852-9cfb-4519-9279-9c60ea34838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2846852-9cfb-4519-9279-9c60ea34838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdc784f-0764-485d-8352-ab56fd3b18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdc784f-0764-485d-8352-ab56fd3b18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c576a971-cb61-417c-a28f-f5b1d34cfd70', 'volume_name': 'volume-c576a971-cb61-417c-a28f-f5b1d34cfd70', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0d419-7417-481f-8959-75c4844ebf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0d419-7417-481f-8959-75c4844ebf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199b647c-f437-4ba4-886d-4d97561f34e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Volume c576a971-cb61-417c-a28f-f5b1d34cfd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c576a971-cb61-417c-a28f-f5b1d34cfd70', 'volume_size': 1}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5669512e-bf1b-4086-91a3-5b6b58525ba0,created_at=2025-09-25T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-242473801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5669512e-bf1b-4086-91a3-5b6b58525ba0,host='devstack@QuobyteHD#QuobyteHD',id=c576a971-cb61-417c-a28f-f5b1d34cfd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:56:53Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd756e6-11b4-412b-a0e2-9ab1ce196a40),volume_type_id=dfd756e6-11b4-412b-a0e2-9ab1ce196a40)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Creating volume c576a971-cb61-417c-a28f-f5b1d34cfd70 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:56:53 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:53 devstack quobyte-client[83978]: System call of process 97072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:53 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=79, name=volume-c576a971-cb61-417c-a28f-f5b1d34cfd70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 1073741824" returned: 0 in 0.345s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] <== create_volume: return (505ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199b647c-f437-4ba4-886d-4d97561f34e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c576a971-cb61-417c-a28f-f5b1d34cfd70', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f76f3b-907a-43c7-bedc-27ef0726a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:56:53 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Volume volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 (c576a971-cb61-417c-a28f-f5b1d34cfd70): created successfully
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f76f3b-907a-43c7-bedc-27ef0726a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:56:53 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (ff9019a5-0f5b-4db8-9a10-43ddac9a574d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:56:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5b086107-61e9-4f1d-abc2-e178d9bd9115 tempest-GroupsTest-820100513 None] Created volume successfully.
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:54 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Acquiring lock "cinder-quobyte-c576a971-cb61-417c-a28f-f5b1d34cfd70" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.358s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-c576a971-cb61-417c-a28f-f5b1d34cfd70" acquired by "delete_volume" :: waited 0.117s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79db643-ce43-450a-99e5-180194d61048]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:55 devstack quobyte-client[83978]: System call of process 97078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:55 devstack quobyte-client[83978]: System call of process 97078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:55 devstack quobyte-client[83978]: System call of process 97078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70" returned: 0 in 0.465s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c576a971-cb61-417c-a28f-f5b1d34cfd70" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-c576a971-cb61-417c-a28f-f5b1d34cfd70" released by "delete_volume" :: held 0.770s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Created reservations ['586d18bd-e11d-4c03-bf30-0a4f13bc9d3d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:56 devstack cinder-volume[83952]: WARNING cinder.quota [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-399762723 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-399762723, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:56 devstack cinder-volume[83952]: WARNING cinder.quota [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-399762723 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-399762723, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Created reservations ['944d4573-5456-45e5-a0fa-1633784eec4b', '9d3fe93a-b093-4dbb-bbf2-e27a01a4d8e0', '1ce539d7-7544-4918-9560-15e9807d3221', '8f01981d-5dcb-46d0-8c27-bc02c27dffd8'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.094s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:56 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:56 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7dd562ee-41e3-4182-bd57-093416df48ee tempest-GroupsTest-820100513 None] Delete group completed successfully.
Sep 25 19:56:57 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Created reservations ['62c0ec97-7e70-4a58-8c68-de8782b89c43'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:56:57 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:56:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b2e3b375-59f9-47fa-ad18-1e3227933729 tempest-GroupsTest-820100513 None] Delete group completed successfully.
Sep 25 19:56:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-33766621-66af-4f5d-8fa8-a6cb85be974a tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:56:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-33766621-66af-4f5d-8fa8-a6cb85be974a tempest-GroupsTest-820100513 None] Group tempest-GroupsTest-Group-1324907589: creating
Sep 25 19:56:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-33766621-66af-4f5d-8fa8-a6cb85be974a tempest-GroupsTest-820100513 None] Group tempest-GroupsTest-Group-1324907589: created successfully
Sep 25 19:56:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-33766621-66af-4f5d-8fa8-a6cb85be974a tempest-GroupsTest-820100513 None] Create group completed successfully.
Sep 25 19:57:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (0b7920c1-1304-47c5-90df-7bc975423cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df9094f-7ee8-4643-beab-63dae9244ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df9094f-7ee8-4643-beab-63dae9244ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907081444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,host='devstack@QuobyteHD#QuobyteHD',id=1de938ef-4136-4c5d-9fdc-242f34509449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:57:00Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51128303-a11b-47c0-bd21-7ed1768270a5),volume_type_id=51128303-a11b-47c0-bd21-7ed1768270a5)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b49176-37bf-4d04-a0fc-df66a47697d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b49176-37bf-4d04-a0fc-df66a47697d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fc93-1718-4323-a456-e8aaa7b9b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fc93-1718-4323-a456-e8aaa7b9b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de938ef-4136-4c5d-9fdc-242f34509449', 'volume_name': 'volume-1de938ef-4136-4c5d-9fdc-242f34509449', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae805655-d0d4-4017-a5e1-c5a3be0c67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae805655-d0d4-4017-a5e1-c5a3be0c67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca3615a-c238-453f-892e-d18e4b493ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:00 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Volume 1de938ef-4136-4c5d-9fdc-242f34509449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de938ef-4136-4c5d-9fdc-242f34509449', 'volume_size': 1}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,created_at=2025-09-25T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907081444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,host='devstack@QuobyteHD#QuobyteHD',id=1de938ef-4136-4c5d-9fdc-242f34509449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:57:00Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51128303-a11b-47c0-bd21-7ed1768270a5),volume_type_id=51128303-a11b-47c0-bd21-7ed1768270a5)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Creating volume 1de938ef-4136-4c5d-9fdc-242f34509449 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:57:00 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:00 devstack quobyte-client[83978]: System call of process 97089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:57:00 devstack quobyte-client[83978]: System call of process 97089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:57:00 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=80, name=volume-1de938ef-4136-4c5d-9fdc-242f34509449, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449 1073741824" returned: 0 in 0.351s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449" returned: 0 in 0.085s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] <== create_volume: return (505ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:57:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca3615a-c238-453f-892e-d18e4b493ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de938ef-4136-4c5d-9fdc-242f34509449', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0f5be7-7bc9-4dcb-ac41-46b36e90c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:01 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Volume volume-1de938ef-4136-4c5d-9fdc-242f34509449 (1de938ef-4136-4c5d-9fdc-242f34509449): created successfully
Sep 25 19:57:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0f5be7-7bc9-4dcb-ac41-46b36e90c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (0b7920c1-1304-47c5-90df-7bc975423cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:57:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cebc4b22-bafe-4513-a8eb-b4694998d07d tempest-GroupsTest-820100513 None] Created volume successfully.
Sep 25 19:57:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (0849d95c-d354-4ee9-98cd-df4660224b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0e9d35-9b44-4a67-ab52-1a9d404097a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0e9d35-9b44-4a67-ab52-1a9d404097a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023534979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,host='devstack@QuobyteHD#QuobyteHD',id=3a868662-50f5-4984-b389-f3c46afe18d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:57:02Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51128303-a11b-47c0-bd21-7ed1768270a5),volume_type_id=51128303-a11b-47c0-bd21-7ed1768270a5)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141dcec5-499f-45a2-89ed-e3164fc2303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141dcec5-499f-45a2-89ed-e3164fc2303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9406812-a035-450e-94f3-38e195a7f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9406812-a035-450e-94f3-38e195a7f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a868662-50f5-4984-b389-f3c46afe18d9', 'volume_name': 'volume-3a868662-50f5-4984-b389-f3c46afe18d9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cf8f2e-7f3f-4973-9b95-cda4f2bfcd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cf8f2e-7f3f-4973-9b95-cda4f2bfcd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a874941-aa76-43cb-b940-a649668fe01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:02 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Volume 3a868662-50f5-4984-b389-f3c46afe18d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a868662-50f5-4984-b389-f3c46afe18d9', 'volume_size': 1}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,created_at=2025-09-25T17:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023534979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbf48a6c-61de-4fd4-a42c-265c947dec51,host='devstack@QuobyteHD#QuobyteHD',id=3a868662-50f5-4984-b389-f3c46afe18d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bedbb4204741569ab624f461e037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:57:02Z,use_quota=True,user_id='0f36f9877da342808bb457f380b5ae3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51128303-a11b-47c0-bd21-7ed1768270a5),volume_type_id=51128303-a11b-47c0-bd21-7ed1768270a5)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Creating volume 3a868662-50f5-4984-b389-f3c46afe18d9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:57:02 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:02 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=81, name=volume-3a868662-50f5-4984-b389-f3c46afe18d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9 1073741824" returned: 0 in 0.353s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9" returned: 0 in 0.099s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a874941-aa76-43cb-b940-a649668fe01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a868662-50f5-4984-b389-f3c46afe18d9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0513958-22ce-4656-a6dd-bfb9193e7c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:57:03 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Volume volume-3a868662-50f5-4984-b389-f3c46afe18d9 (3a868662-50f5-4984-b389-f3c46afe18d9): created successfully
Sep 25 19:57:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0513958-22ce-4656-a6dd-bfb9193e7c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:57:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Flow 'volume_create_manager' (0849d95c-d354-4ee9-98cd-df4660224b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:57:03 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bb67c42a-85b8-4e45-b4ec-392592a3f31b tempest-GroupsTest-820100513 None] Created volume successfully.
Sep 25 19:57:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8dcf75e7-6e99-4401-aae8-87f06e52651c tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8dcf75e7-6e99-4401-aae8-87f06e52651c tempest-GroupsTest-820100513 None] Update group completed successfully.
Sep 25 19:57:05 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5d7e4dd4-7bde-42a7-835c-a6768f0bd286 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5d7e4dd4-7bde-42a7-835c-a6768f0bd286 tempest-GroupsTest-820100513 None] Update group completed successfully.
Sep 25 19:57:07 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Acquiring lock "cinder-quobyte-1de938ef-4136-4c5d-9fdc-242f34509449" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-1de938ef-4136-4c5d-9fdc-242f34509449" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a00e5-060d-402c-82cc-ccbb68f4ad13]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:07 devstack quobyte-client[83978]: System call of process 97098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449" returned: 0 in 0.405s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-1de938ef-4136-4c5d-9fdc-242f34509449" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-1de938ef-4136-4c5d-9fdc-242f34509449" released by "delete_volume" :: held 0.672s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Acquiring lock "cinder-quobyte-3a868662-50f5-4984-b389-f3c46afe18d9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-3a868662-50f5-4984-b389-f3c46afe18d9" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc294ded-8ac6-4d39-b871-acfc25523b6c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:57:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:08 devstack quobyte-client[83978]: System call of process 97102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9" returned: 0 in 0.400s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3a868662-50f5-4984-b389-f3c46afe18d9" returned: 0 in 0.136s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "cinder-quobyte-3a868662-50f5-4984-b389-f3c46afe18d9" released by "delete_volume" :: held 0.683s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Created reservations ['044b45a5-49ae-4794-9187-44c3cd93097e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:57:08 devstack cinder-volume[83952]: WARNING cinder.quota [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1841712878 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1841712878, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:57:08 devstack cinder-volume[83952]: WARNING cinder.quota [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1841712878 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1841712878, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Created reservations ['acabd121-491e-4924-ac2a-445e4268d57b', '3de6ab0b-a7e0-4712-ae70-22fe0c0588b9', '9b845316-f240-4062-a0b1-9e17267d16a2', '342490bf-96ac-4731-9ed1-42665496304e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:57:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Created reservations ['a246ee83-4834-4ca1-9583-499f477b0e5a', '4beb2603-1e03-4406-9d31-8e933872fd5d', '81400d89-836c-438d-9212-8b07a69d53c3', '0c34476c-faf0-4c1f-91a6-c61d6927f5ec'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:09 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:57:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4c44a09a-82ac-4997-a4d0-dbe015d8abd3 tempest-GroupsTest-820100513 None] Delete group completed successfully.
Sep 25 19:57:19 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=110,cinder:UPDATE=106,cinder:INSERT=21,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:57:19 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:INSERT=20,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:57:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "cinder-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "cinder-quobyte-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-quobyte-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0799f3d-fcb3-4992-a799-6da804eb40cd]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:57:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" returned: 0 in 0.539s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-quobyte-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3" released by "delete_volume" :: held 0.878s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Created reservations ['4d074746-1191-432c-b1c8-88f713e94aba', 'b6816f5f-dac0-45c0-b0e9-16a80220137a', 'bf913f3e-dd84-4088-9a56-aee9a6fa36f4', '963b95a5-6e80-4a8e-a6bd-c9fb5d22f604'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:47 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:57:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Deleted volume successfully.
Sep 25 19:57:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-07c4f0bc-dac6-4433-bcbf-aba58253bd26 tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-5a28d2f3-9e4d-438b-a5ad-a2e08a7d1af3-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "cinder-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "cinder-quobyte-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-quobyte-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2a675-9d9a-4702-bf23-d1edcbbb0909]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:48 devstack quobyte-client[83978]: System call of process 97220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" returned: 0 in 0.510s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-quobyte-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5" released by "delete_volume" :: held 0.804s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Created reservations ['c6109f04-9b04-4140-adf1-5c7792d8c5ed', '3af0a0d3-d861-426e-9966-573f3c20c9a7', 'bd81d6e0-2384-42c6-ab52-adb18dc5c373', '88c176b8-cabb-49d7-a0d3-ff2784c6bc01'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.136s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:57:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Deleted volume successfully.
Sep 25 19:57:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d733d2b7-b1e7-418a-bff1-a4e9f4c5530e tempest-AttachVolumeShelveTestJSON-379407002 None] Lock "cinder-ee5d999b-f9ed-43b8-a81d-ef6dcd9458a5-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.115s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:57:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:57:59 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:57:59 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:58:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Flow 'volume_create_manager' (7d477d51-ffb0-4f59-a25f-92a040808f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5da655-5216-4e6c-960f-3a23ec4fc23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5da655-5216-4e6c-960f-3a23ec4fc23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-907457428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abe58f9-7c3d-47bb-b237-20f24a88244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8992373b544a058687ce247b855898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:01Z,use_quota=True,user_id='fc76575c9cdb4d3d8a140129d0664299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947d7d7c-1856-463e-93e3-3611f7020a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947d7d7c-1856-463e-93e3-3611f7020a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e95fb8d-8830-44f3-a93e-a17b9c88ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e95fb8d-8830-44f3-a93e-a17b9c88ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abe58f9-7c3d-47bb-b237-20f24a88244b', 'volume_name': 'volume-6abe58f9-7c3d-47bb-b237-20f24a88244b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e409ff1b-837a-476e-a245-d41a94903b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e409ff1b-837a-476e-a245-d41a94903b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf36ec9-c5f8-4a7d-91c2-bc3f463987db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:01 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Volume 6abe58f9-7c3d-47bb-b237-20f24a88244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abe58f9-7c3d-47bb-b237-20f24a88244b', 'volume_size': 1}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-907457428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abe58f9-7c3d-47bb-b237-20f24a88244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8992373b544a058687ce247b855898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:01Z,use_quota=True,user_id='fc76575c9cdb4d3d8a140129d0664299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Creating volume 6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:58:01 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:01 devstack quobyte-client[83978]: System call of process 97230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:01 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=82, name=volume-6abe58f9-7c3d-47bb-b237-20f24a88244b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b 1073741824" returned: 0 in 0.358s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b" returned: 0 in 0.131s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] <== create_volume: return (575ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:58:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.597s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf36ec9-c5f8-4a7d-91c2-bc3f463987db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abe58f9-7c3d-47bb-b237-20f24a88244b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f479f-9d8f-4397-a2db-460e16237b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:02 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Volume volume-6abe58f9-7c3d-47bb-b237-20f24a88244b (6abe58f9-7c3d-47bb-b237-20f24a88244b): created successfully
Sep 25 19:58:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f479f-9d8f-4397-a2db-460e16237b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Flow 'volume_create_manager' (7d477d51-ffb0-4f59-a25f-92a040808f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-e5e93261-c32f-4e1c-9f9b-0ffd197872a0 req-703a0788-8f22-4840-97a3-9d2c68784913 tempest-VolumesSnapshotsTestJSON-673849646 None] Created volume successfully.
Sep 25 19:58:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Creating offline snapshot 1c965f96-83b4-490b-88fa-045d71641bf2 of volume 6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7a580-2314-4dae-aa3b-704858e9b736]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b" returned: 0 in 0.459s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:04 devstack quobyte-client[83978]: System call of process 97237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:04 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=83, name=volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 1G" returned: 0 in 0.311s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6abe58f9-7c3d-47bb-b237-20f24a88244b -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:04 devstack quobyte-client[83978]: System call of process 97240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:04 devstack quobyte-client[83978]: System call of process 97240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:04 devstack quobyte-client[83978]: System call of process 97240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "qemu-img rebase -u -b volume-6abe58f9-7c3d-47bb-b237-20f24a88244b -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.199s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.135s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.117s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.info" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.info" returned: 0 in 0.124s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-f8b67acb-59c7-4546-82fd-03a64de1471f req-ca7749dc-67a7-4d1b-bf2e-7c28f37e857f tempest-VolumesSnapshotsTestJSON-673849646 None] Create snapshot completed successfully
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "cinder-1c965f96-83b4-490b-88fa-045d71641bf2-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-1c965f96-83b4-490b-88fa-045d71641bf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:05 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "cinder-quobyte-1c965f96-83b4-490b-88fa-045d71641bf2" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-1c965f96-83b4-490b-88fa-045d71641bf2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Deleting offline snapshot 1c965f96-83b4-490b-88fa-045d71641bf2 of volume 6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] snapshot_file for this snap is: volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9a500-6f27-4c26-9b7d-567a903b0dac]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:06 devstack quobyte-client[83978]: System call of process 97248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:06 devstack quobyte-client[83978]: System call of process 97248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.483s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6abe58f9-7c3d-47bb-b237-20f24a88244b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e691a-72b5-4520-9de8-f88d54d32a6e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b" returned: 0 in 0.497s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.272s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b.1c965f96-83b4-490b-88fa-045d71641bf2" returned: 0 in 0.104s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-1c965f96-83b4-490b-88fa-045d71641bf2" released by "_delete_snapshot" :: held 1.718s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" released by "delete_snapshot" :: held 1.753s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:07 devstack cinder-volume[83952]: DEBUG cinder.quota [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Created reservations ['dd6fa13f-acca-4f4b-914e-168b8cadf4b1', '3cbbe9ae-163a-4892-8233-8f5eb91afcec', '326de237-95d9-4ae3-90ca-2a6ea9661b3a', 'ed671e33-18c7-4c81-8cd5-4db66e24eef3'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Delete snapshot completed successfully.
Sep 25 19:58:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-b5410b7c-8075-4b78-8be0-5642f9e6fa62 req-5fcd0775-2b71-4837-b938-ab399cf5f10b tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-1c965f96-83b4-490b-88fa-045d71641bf2-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "cinder-6abe58f9-7c3d-47bb-b237-20f24a88244b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-6abe58f9-7c3d-47bb-b237-20f24a88244b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c89111d-7794-4163-ac7f-dd036a6eabc7]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:09 devstack quobyte-client[83978]: System call of process 97258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b" returned: 0 in 0.423s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6abe58f9-7c3d-47bb-b237-20f24a88244b" returned: 0 in 0.121s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-quobyte-6abe58f9-7c3d-47bb-b237-20f24a88244b" released by "delete_volume" :: held 0.693s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG cinder.quota [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Created reservations ['4404b822-2705-49f7-ad52-f6f6cb1d475e', 'eeae6fa4-01ac-4429-bd57-046602aa6610', '48be9256-0146-461f-b3a7-1a685457da4a', 'ff53c0c2-8f24-4049-81e9-6fdd65739725'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG cinder.manager [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:58:10 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Deleted volume successfully.
Sep 25 19:58:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [req-c6f17e08-55b4-41cf-8795-5564d914a702 req-106105da-d0b5-4213-93b7-487ce632bae6 tempest-VolumesSnapshotsTestJSON-673849646 None] Lock "cinder-6abe58f9-7c3d-47bb-b237-20f24a88244b-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ead9bdc9-b04e-4c4d-9d2d-c5c1c73a08c9 tempest-BackendsCapabilitiesAdminTestsJSON-352980855 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83952) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 25 19:58:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-879e8068-d2aa-4c66-ba16-3e6106981f5d tempest-BackendsCapabilitiesAdminTestsJSON-352980855 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83952) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 25 19:58:20 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=9,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:58:20 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:58:22 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-054f934f-aa51-4e72-b61b-d110ca2c4752 tempest-GroupSnapshotsV319Test-891326529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-054f934f-aa51-4e72-b61b-d110ca2c4752 tempest-GroupSnapshotsV319Test-891326529 None] Group tempest-GroupSnapshotsV319Test-Group-1186680776: creating
Sep 25 19:58:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-054f934f-aa51-4e72-b61b-d110ca2c4752 tempest-GroupSnapshotsV319Test-891326529 None] Group tempest-GroupSnapshotsV319Test-Group-1186680776: created successfully
Sep 25 19:58:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-054f934f-aa51-4e72-b61b-d110ca2c4752 tempest-GroupSnapshotsV319Test-891326529 None] Create group completed successfully.
Sep 25 19:58:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Flow 'volume_create_manager' (155aa0ff-f5f5-4598-9085-8f7d3e56c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3082e5-f81f-4730-889a-671bea5b7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3082e5-f81f-4730-889a-671bea5b7928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1816472788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f47d52c4-48f5-41f5-9b85-a84e9aa1b6ac,host='devstack@QuobyteHD#QuobyteHD',id=01dc4154-ab4f-47fd-8cb9-a50b637a3339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96f4b5afa39464b9c9ed0d1b5d12866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:24Z,use_quota=True,user_id='0ef2811ca8764d658f8ed30065833e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162f6c38-cdd0-4116-9763-c2c0ef0b84f4),volume_type_id=162f6c38-cdd0-4116-9763-c2c0ef0b84f4)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f27443-15d0-4680-9b88-85fb92d16285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f27443-15d0-4680-9b88-85fb92d16285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5052700a-577a-440e-9ed6-3fc7bb572f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5052700a-577a-440e-9ed6-3fc7bb572f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dc4154-ab4f-47fd-8cb9-a50b637a3339', 'volume_name': 'volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e8318e-330a-44ec-acbf-cbd6d1a75885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e8318e-330a-44ec-acbf-cbd6d1a75885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89624f83-c112-48e9-8269-ee91c6f32ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:24 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Volume 01dc4154-ab4f-47fd-8cb9-a50b637a3339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339', 'volume_size': 1}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f47d52c4-48f5-41f5-9b85-a84e9aa1b6ac,created_at=2025-09-25T17:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1816472788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f47d52c4-48f5-41f5-9b85-a84e9aa1b6ac,host='devstack@QuobyteHD#QuobyteHD',id=01dc4154-ab4f-47fd-8cb9-a50b637a3339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96f4b5afa39464b9c9ed0d1b5d12866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:24Z,use_quota=True,user_id='0ef2811ca8764d658f8ed30065833e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162f6c38-cdd0-4116-9763-c2c0ef0b84f4),volume_type_id=162f6c38-cdd0-4116-9763-c2c0ef0b84f4)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Creating volume 01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:58:24 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:24 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=85, name=volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 1073741824" returned: 0 in 0.403s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339" returned: 0 in 0.085s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.567s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89624f83-c112-48e9-8269-ee91c6f32ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad88310f-b2a7-4923-be8f-85e221876179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:25 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Volume volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 (01dc4154-ab4f-47fd-8cb9-a50b637a3339): created successfully
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad88310f-b2a7-4923-be8f-85e221876179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Flow 'volume_create_manager' (155aa0ff-f5f5-4598-9085-8f7d3e56c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-74b46dc6-46e8-47f8-9095-8c5b2d4cd0b3 tempest-GroupSnapshotsV319Test-891326529 None] Created volume successfully.
Sep 25 19:58:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] GroupSnapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: creating.
Sep 25 19:58:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Group snapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: creating. {{(pid=83952) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Creating offline snapshot d4fce45b-91aa-4779-808a-3905e69f14b5 of volume 01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4f18b6-e76e-4a43-935d-74e86b4f4108]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339" returned: 0 in 0.490s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:26 devstack quobyte-client[83978]: System call of process 97304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:26 devstack quobyte-client[83978]: System call of process 97304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:26 devstack quobyte-client[83978]: System call of process 97304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:26 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=86, name=volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 1G" returned: 0 in 0.288s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): qemu-img rebase -u -b volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:26 devstack quobyte-client[83978]: System call of process 97309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "qemu-img rebase -u -b volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:58:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.112s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.369s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.info" returned: 0 in 0.159s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:58:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.info" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7cc237fe-5d07-4b30-af21-f159009dc97f tempest-GroupSnapshotsV319Test-891326529 None] group_snapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: created successfully
Sep 25 19:58:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] group_snapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: deleting
Sep 25 19:58:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] group_snapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: deleting {{(pid=83952) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" acquired by "delete_snapshot" :: waited 0.139s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "cinder-quobyte-d4fce45b-91aa-4779-808a-3905e69f14b5" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-d4fce45b-91aa-4779-808a-3905e69f14b5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Deleting offline snapshot d4fce45b-91aa-4779-808a-3905e69f14b5 of volume 01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] snapshot_file for this snap is: volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702c3e7-b670-46f0-8922-c344665ca433]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.699s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd4dd5-6556-43dc-8778-26b4998bcf7e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:31 devstack quobyte-client[83978]: System call of process 97373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:31 devstack quobyte-client[83978]: System call of process 97373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339" returned: 0 in 0.698s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:32 devstack quobyte-client[83978]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:32 devstack quobyte-client[83978]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:32 devstack quobyte-client[83978]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:32 devstack quobyte-client[83978]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.270s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339.d4fce45b-91aa-4779-808a-3905e69f14b5" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-d4fce45b-91aa-4779-808a-3905e69f14b5" released by "_delete_snapshot" :: held 2.239s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" released by "delete_snapshot" :: held 2.263s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:32 devstack cinder-volume[83952]: WARNING cinder.quota [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-550325927 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-550325927, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:58:32 devstack cinder-volume[83952]: WARNING cinder.quota [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-550325927 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-550325927, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:58:32 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] Created reservations ['2f6a65e0-5c08-40cf-90d1-4497b6aa4b29', 'bc17aace-875b-4e78-bab0-d878409d2167', '27786561-fdb9-400d-b95e-7ae194201136', 'c66add99-f842-48cf-96dd-6a9d4bd081e9'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-10683826-5877-404d-88db-81eb94800b15 tempest-GroupSnapshotsV319Test-891326529 None] group_snapshot 917f21fa-1ef4-426f-9a3b-4f2be17a30d6: deleted successfully
Sep 25 19:58:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" acquired by "delete_volume" :: waited 0.037s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:33 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50a637-eb05-4459-85f7-6d29eaf2b215]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339" returned: 0 in 0.525s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-01dc4154-ab4f-47fd-8cb9-a50b637a3339" returned: 0 in 0.092s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Lock "cinder-quobyte-01dc4154-ab4f-47fd-8cb9-a50b637a3339" released by "delete_volume" :: held 0.806s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:34 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Created reservations ['af25c818-73b4-43c1-9589-0d8de217345b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:34 devstack cinder-volume[83952]: WARNING cinder.quota [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-550325927 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-550325927, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Created reservations ['091373ca-21f5-4d8f-bb3a-55aac01128d0', '17b03234-6526-43a9-9b52-b3b59eec7b5e', '975f600d-3fed-4cc0-9992-0ab1c4dc7233', '4e60c9f8-9ee0-430f-94b0-2123cfb740e0'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.128s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:35 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:58:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8466085d-d0ff-44dd-b03c-04f90b80a7d2 tempest-GroupSnapshotsV319Test-891326529 None] Delete group completed successfully.
Sep 25 19:58:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5bf58137-abfd-4a3b-a921-6ade5a7b3806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38aca17-d5c9-4068-ac02-3dc8789979bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38aca17-d5c9-4068-ac02-3dc8789979bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433364692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7c2e7-b8f1-4b38-9277-f762c38ac7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:37Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27a8784-62b7-446c-8d04-67b8be15ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27a8784-62b7-446c-8d04-67b8be15ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75c4f00-16a9-4cd8-9a5d-eff94658f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75c4f00-16a9-4cd8-9a5d-eff94658f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b7c2e7-b8f1-4b38-9277-f762c38ac7b6', 'volume_name': 'volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece1fbf-39c0-4363-9cde-ddbbc4be2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece1fbf-39c0-4363-9cde-ddbbc4be2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3404ce-222b-4f91-bd3b-76259a33d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Volume 50b7c2e7-b8f1-4b38-9277-f762c38ac7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6', 'volume_size': 1}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433364692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b7c2e7-b8f1-4b38-9277-f762c38ac7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:37Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Creating volume 50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:58:37 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:58:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:38 devstack quobyte-client[83978]: System call of process 97394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:38 devstack quobyte-client[83978]: System call of process 97394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:38 devstack quobyte-client[83978]: System call of process 97394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:38 devstack quobyte-client[83978]: System call of process 97394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:58:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=88, name=volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 1073741824" returned: 0 in 0.528s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" returned: 0 in 0.196s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] <== create_volume: return (817ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:58:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3404ce-222b-4f91-bd3b-76259a33d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ffd504-d893-4ffa-aeaa-d94942faea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Volume volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 (50b7c2e7-b8f1-4b38-9277-f762c38ac7b6): created successfully
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ffd504-d893-4ffa-aeaa-d94942faea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5bf58137-abfd-4a3b-a921-6ade5a7b3806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ebb29827-9fe4-40a5-b1f9-4e31b70c7da9 tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" by "attach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" acquired by "attach_volume" :: waited 0.054s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:40 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Attaching volume 50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 to instance d896a391-3efc-41b2-b560-40cecefd0c4c at mountpoint /dev/vdb on host None.
Sep 25 19:58:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Attach volume completed successfully.
Sep 25 19:58:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8187302e-87fe-428d-8787-579531ed84ec tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" released by "attach_volume" :: held 0.443s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Terminate volume connection completed successfully.
Sep 25 19:58:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" by "detach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Detaching volume 50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 from instance d896a391-3efc-41b2-b560-40cecefd0c4c.
Sep 25 19:58:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Detach volume completed successfully.
Sep 25 19:58:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e0824b35-06da-47ee-8999-7d3fdd9cd588 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a1c2216-84b7-4353-8ca8-ffad4afbf9d8 tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" by "detach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a1c2216-84b7-4353-8ca8-ffad4afbf9d8 tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:42 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5a1c2216-84b7-4353-8ca8-ffad4afbf9d8 tempest-VolumesActionsTest-194766139 None] Volume detach called, but volume not attached.
Sep 25 19:58:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a1c2216-84b7-4353-8ca8-ffad4afbf9d8 tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-quobyte-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "cinder-quobyte-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" acquired by "delete_volume" :: waited 0.037s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[54405cb7-cf56-48e5-aea1-a83c3421b482]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:58:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" returned: 0 in 1.413s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" returned: 0 in 0.152s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "cinder-quobyte-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6" released by "delete_volume" :: held 1.874s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Created reservations ['4ed6e001-93b1-435b-adc7-cec8cf7a5a7c', '60e15b35-856b-43f2-b72c-7e8738044eaf', 'f014c0c2-a4cd-44cc-ba38-0bb48e473993', '716a2750-d59a-47a1-b854-de702d20bf19'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.267s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:47 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:58:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Deleted volume successfully.
Sep 25 19:58:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cb416c94-3705-4ef5-80ea-e37f5384d49d tempest-VolumesActionsTest-194766139 None] Lock "cinder-50b7c2e7-b8f1-4b38-9277-f762c38ac7b6-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.114s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=41,cinder:UPDATE=43,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:58:57 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (064d346e-1bfc-40a2-a1b3-fd1e6ec32077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89252c0-62ee-4714-bf88-7225ac937f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89252c0-62ee-4714-bf88-7225ac937f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685590549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f43461f-dc52-4887-b92f-80484b094a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:58Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaa48e4-f92c-49f0-afb2-1e42818920a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaa48e4-f92c-49f0-afb2-1e42818920a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db09cfe0-2add-4a86-b2ac-d4bb904c25b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db09cfe0-2add-4a86-b2ac-d4bb904c25b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f43461f-dc52-4887-b92f-80484b094a28', 'volume_name': 'volume-7f43461f-dc52-4887-b92f-80484b094a28', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363f9c69-0856-4a20-8c70-e4f069790e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363f9c69-0856-4a20-8c70-e4f069790e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860065f-8835-4337-a96e-0088e11b695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:58 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Volume 7f43461f-dc52-4887-b92f-80484b094a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f43461f-dc52-4887-b92f-80484b094a28', 'volume_size': 1}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685590549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f43461f-dc52-4887-b92f-80484b094a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:58:58Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Creating volume 7f43461f-dc52-4887-b92f-80484b094a28 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:58:58 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:58 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=89, name=volume-7f43461f-dc52-4887-b92f-80484b094a28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28 1073741824" returned: 0 in 0.388s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28" returned: 0 in 0.156s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c860065f-8835-4337-a96e-0088e11b695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f43461f-dc52-4887-b92f-80484b094a28', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd06f9e-6cb2-4c8e-9d78-4b41b6a24c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:58:58 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Volume volume-7f43461f-dc52-4887-b92f-80484b094a28 (7f43461f-dc52-4887-b92f-80484b094a28): created successfully
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd06f9e-6cb2-4c8e-9d78-4b41b6a24c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:58:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (064d346e-1bfc-40a2-a1b3-fd1e6ec32077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:58:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f30d25cc-144f-41c6-859f-3e46748f8acf tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-7f43461f-dc52-4887-b92f-80484b094a28-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "cinder-7f43461f-dc52-4887-b92f-80484b094a28-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-quobyte-7f43461f-dc52-4887-b92f-80484b094a28" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-7f43461f-dc52-4887-b92f-80484b094a28" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2d2e6-7a30-41c6-9054-263487a5b911]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28" returned: 0 in 0.491s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7f43461f-dc52-4887-b92f-80484b094a28" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-7f43461f-dc52-4887-b92f-80484b094a28" released by "delete_volume" :: held 0.788s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Created reservations ['0acca1d6-a837-4582-b7d8-63a6536de1d6', '2b02e253-871a-4b4d-93a0-4e3d935fa661', '48d91114-c2eb-4442-bb86-9a8908c60b2e', '27d394d1-a9d6-42a3-908b-fc3365ce36e6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:01 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Deleted volume successfully.
Sep 25 19:59:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e26a453a-0fa5-46ce-93e2-21c0c478786a tempest-VolumesActionsTest-1827232013 None] Lock "cinder-7f43461f-dc52-4887-b92f-80484b094a28-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:03 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (6955f830-c02f-4f89-b73e-5f792f9b4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7e1c4-9faf-408f-814e-6661ae359915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7e1c4-9faf-408f-814e-6661ae359915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23602849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26c5f79-128b-4944-be6f-d2f8e04ce528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:03Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d9396-2c2c-4518-bec7-f84c20da4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d9396-2c2c-4518-bec7-f84c20da4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536e0e2b-eab1-46af-9570-6aded4b9393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536e0e2b-eab1-46af-9570-6aded4b9393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26c5f79-128b-4944-be6f-d2f8e04ce528', 'volume_name': 'volume-a26c5f79-128b-4944-be6f-d2f8e04ce528', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0afa71-7c02-4b29-ad85-f0d8339537a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0afa71-7c02-4b29-ad85-f0d8339537a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce2f2d3-4d37-4e3d-a72a-7183dc1393cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:03 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Volume a26c5f79-128b-4944-be6f-d2f8e04ce528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26c5f79-128b-4944-be6f-d2f8e04ce528', 'volume_size': 1}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23602849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26c5f79-128b-4944-be6f-d2f8e04ce528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:03Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Creating volume a26c5f79-128b-4944-be6f-d2f8e04ce528 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:03 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:03 devstack quobyte-client[83978]: System call of process 97547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:03 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=90, name=volume-a26c5f79-128b-4944-be6f-d2f8e04ce528, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 1073741824" returned: 0 in 0.367s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.544s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce2f2d3-4d37-4e3d-a72a-7183dc1393cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26c5f79-128b-4944-be6f-d2f8e04ce528', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02275cb3-546c-4b00-b260-a8759b9412f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:04 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Volume volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 (a26c5f79-128b-4944-be6f-d2f8e04ce528): created successfully
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02275cb3-546c-4b00-b260-a8759b9412f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:04 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (6955f830-c02f-4f89-b73e-5f792f9b4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:04 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8bb20840-fb23-4a3c-b15b-a8bc70e3f0f0 tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:59:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-a26c5f79-128b-4944-be6f-d2f8e04ce528-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-a26c5f79-128b-4944-be6f-d2f8e04ce528-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:05 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-quobyte-a26c5f79-128b-4944-be6f-d2f8e04ce528" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-a26c5f79-128b-4944-be6f-d2f8e04ce528" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1e1fa5-367e-4139-acc2-f00fe3913b8f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:06 devstack quobyte-client[83978]: System call of process 97552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528" returned: 0 in 0.424s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a26c5f79-128b-4944-be6f-d2f8e04ce528" returned: 0 in 0.086s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-a26c5f79-128b-4944-be6f-d2f8e04ce528" released by "delete_volume" :: held 0.662s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:06 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Created reservations ['65f8e379-f274-41cc-a255-1eb0ce078cc7', '088ef299-604e-43ff-92fa-8b619e7477e4', 'f7f98440-d1dc-4d48-9dea-2ce0d3d5c2d8', '3ee7e7e4-f421-453b-bb83-1b9db01235cd'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.096s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:07 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Deleted volume successfully.
Sep 25 19:59:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbb85757-bfda-4eee-9050-6a0958957392 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-a26c5f79-128b-4944-be6f-d2f8e04ce528-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (57440fa7-9e45-4a64-ab93-5c94a23391fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfabf30-dfb3-4523-9302-b7226d071646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfabf30-dfb3-4523-9302-b7226d071646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301510985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab578bb8-cb70-4639-be28-d6145e0c6b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:09Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f1fc2f-b0bb-4889-a5e3-432901817146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f1fc2f-b0bb-4889-a5e3-432901817146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5ab013-6773-40dd-82f2-02f501c47137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5ab013-6773-40dd-82f2-02f501c47137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab578bb8-cb70-4639-be28-d6145e0c6b87', 'volume_name': 'volume-ab578bb8-cb70-4639-be28-d6145e0c6b87', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d624bd03-f6e5-43eb-b9a7-1c9f5249aaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d624bd03-f6e5-43eb-b9a7-1c9f5249aaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97391703-ba5f-436e-9cee-ec1d9c6fe046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:08 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Volume ab578bb8-cb70-4639-be28-d6145e0c6b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab578bb8-cb70-4639-be28-d6145e0c6b87', 'volume_size': 1}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301510985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab578bb8-cb70-4639-be28-d6145e0c6b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:09Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Creating volume ab578bb8-cb70-4639-be28-d6145e0c6b87 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:08 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:09 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=91, name=volume-ab578bb8-cb70-4639-be28-d6145e0c6b87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 1073741824" returned: 0 in 0.386s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97391703-ba5f-436e-9cee-ec1d9c6fe046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab578bb8-cb70-4639-be28-d6145e0c6b87', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bad0bec-eb8b-416f-bbcd-da9f5b571d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:09 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Volume volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 (ab578bb8-cb70-4639-be28-d6145e0c6b87): created successfully
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bad0bec-eb8b-416f-bbcd-da9f5b571d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (57440fa7-9e45-4a64-ab93-5c94a23391fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1fefcd0a-c2ee-4a5d-9a15-b0d2e3bdf6c1 tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:59:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-ab578bb8-cb70-4639-be28-d6145e0c6b87-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-ab578bb8-cb70-4639-be28-d6145e0c6b87-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:11 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-quobyte-ab578bb8-cb70-4639-be28-d6145e0c6b87" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-ab578bb8-cb70-4639-be28-d6145e0c6b87" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e874bf-7b9b-4303-8a40-302f5f2767ea]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87" returned: 0 in 0.458s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ab578bb8-cb70-4639-be28-d6145e0c6b87" returned: 0 in 0.108s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-ab578bb8-cb70-4639-be28-d6145e0c6b87" released by "delete_volume" :: held 0.738s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Created reservations ['1d9b1916-74bb-463a-9316-29d52eadf9c5', '201dc63e-25c6-41a4-851b-60b3be0d3ce0', 'f67e3c15-2e13-48e9-8961-527e9bc19d0e', 'aeb68245-2ad8-4bbe-9147-cade1cd7801b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Deleted volume successfully.
Sep 25 19:59:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3d50ad5b-1aa0-45f1-b382-b69eeec73967 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-ab578bb8-cb70-4639-be28-d6145e0c6b87-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:13 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5d6aeddc-b286-41a7-84f7-dd1dc396e08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc382590-aeb4-458d-aa58-4dbac43b637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Flow 'volume_create_manager' (8ea089db-0826-4447-b0dd-c9c02ab8ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f34026-c37e-4ef2-a192-e819e41743b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc382590-aeb4-458d-aa58-4dbac43b637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1615301458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b43393-d0a4-4a1f-aab0-4b606004b8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:14Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3984b216-15b6-45fe-ad2b-64b6c2035c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3984b216-15b6-45fe-ad2b-64b6c2035c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b07be8-07b3-46ac-b70d-c33ba763a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b07be8-07b3-46ac-b70d-c33ba763a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b43393-d0a4-4a1f-aab0-4b606004b8f6', 'volume_name': 'volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104d4cd-7898-4250-8701-ccdfe8abb357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104d4cd-7898-4250-8701-ccdfe8abb357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa60c76-79c0-4259-918a-d3d784c0fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Volume 21b43393-d0a4-4a1f-aab0-4b606004b8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6', 'volume_size': 1}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1615301458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b43393-d0a4-4a1f-aab0-4b606004b8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:14Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Creating volume 21b43393-d0a4-4a1f-aab0-4b606004b8f6 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:14 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=92, name=volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f34026-c37e-4ef2-a192-e819e41743b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1794789938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90da8333-96f7-4e53-aa41-2e2c4bc96ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61890cdd5d6424bb90ba5308e03321e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:14Z,use_quota=True,user_id='281f1c3ec633404a9af51e85e9b7ce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283de717-a2bb-409e-8e62-6b316cfb970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283de717-a2bb-409e-8e62-6b316cfb970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aaf1fd-2df7-4ecd-b728-7d0566b664aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aaf1fd-2df7-4ecd-b728-7d0566b664aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90da8333-96f7-4e53-aa41-2e2c4bc96ffa', 'volume_name': 'volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb301a9-0f57-4c86-a986-03dc8df74184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb301a9-0f57-4c86-a986-03dc8df74184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b10ce3c-e783-43b3-b960-844f43b483bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:14 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume 90da8333-96f7-4e53-aa41-2e2c4bc96ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa', 'volume_size': 1}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 1073741824" returned: 0 in 0.385s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6" returned: 0 in 0.075s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] <== create_volume: return (501ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.512s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.239s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1794789938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90da8333-96f7-4e53-aa41-2e2c4bc96ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61890cdd5d6424bb90ba5308e03321e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:14Z,use_quota=True,user_id='281f1c3ec633404a9af51e85e9b7ce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Creating volume 90da8333-96f7-4e53-aa41-2e2c4bc96ffa {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:14 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:14 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=93, name=volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa60c76-79c0-4259-918a-d3d784c0fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1377ecfb-4f25-4b27-8143-18459048ca12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa 1073741824" returned: 0 in 0.377s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:15 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Volume volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 (21b43393-d0a4-4a1f-aab0-4b606004b8f6): created successfully
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1377ecfb-4f25-4b27-8143-18459048ca12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5d6aeddc-b286-41a7-84f7-dd1dc396e08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" returned: 0 in 0.275s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] <== create_volume: return (681ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8071bb48-652c-48eb-b315-a7cd97255dda tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b10ce3c-e783-43b3-b960-844f43b483bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619efaa2-d2a9-40fa-8d39-ee9da7e13414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:15 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa (90da8333-96f7-4e53-aa41-2e2c4bc96ffa): created successfully
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619efaa2-d2a9-40fa-8d39-ee9da7e13414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Flow 'volume_create_manager' (8ea089db-0826-4447-b0dd-c9c02ab8ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b0a3c06a-7099-4687-90ad-2412e6ae0edb tempest-VolumeQuotasAdminTestJSON-412569437 None] Created volume successfully.
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-21b43393-d0a4-4a1f-aab0-4b606004b8f6-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "cinder-90da8333-96f7-4e53-aa41-2e2c4bc96ffa-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-21b43393-d0a4-4a1f-aab0-4b606004b8f6-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "cinder-90da8333-96f7-4e53-aa41-2e2c4bc96ffa-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "cinder-quobyte-21b43393-d0a4-4a1f-aab0-4b606004b8f6" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "cinder-quobyte-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-21b43393-d0a4-4a1f-aab0-4b606004b8f6" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "cinder-quobyte-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a9e46d-f4d6-4b81-9d29-5d755373c606]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd78fbf5-b8fd-4968-b76f-cf4ce99969ea]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:16 devstack quobyte-client[83978]: System call of process 97577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6" returned: 0 in 0.488s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" returned: 0 in 0.579s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-21b43393-d0a4-4a1f-aab0-4b606004b8f6" returned: 0 in 0.187s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-quobyte-21b43393-d0a4-4a1f-aab0-4b606004b8f6" released by "delete_volume" :: held 0.847s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" returned: 0 in 0.284s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "cinder-quobyte-90da8333-96f7-4e53-aa41-2e2c4bc96ffa" released by "delete_volume" :: held 1.002s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Created reservations ['28b0c72a-2cc5-482a-a419-d5d45201f659', 'c283be34-fdc8-4e14-bbd7-5a959f811958', '8d1ab29f-95b9-485e-ad5c-9b9ba8603339', '7acce262-c424-4b5c-bf19-bf983c2fee2b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Created reservations ['bf264d65-d544-440a-8f86-7ce348970349', '192eefb1-f9e6-4e41-b7c6-c120e9240adf', '52185bed-c3b3-4767-a56e-033c1d38cf96', 'fe0f7e3e-a5b0-452b-8d5c-acc66a136de8'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.172s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:17 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Deleted volume successfully.
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-08eef45d-3e47-4318-87fe-b60da2a17916 tempest-VolumesActionsTest-1827232013 None] Lock "cinder-21b43393-d0a4-4a1f-aab0-4b606004b8f6-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.078s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Deleted volume successfully.
Sep 25 19:59:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b7a45c07-b0d9-46c9-a855-bbfc1ab54151 tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "cinder-90da8333-96f7-4e53-aa41-2e2c4bc96ffa-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Flow 'volume_create_manager' (ab77e3a6-801a-46e6-bc57-a88a0db07c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01591fa-8c97-462b-888b-ad3ba23648fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5a4cdf54-2171-450a-a5e2-0784862ce4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76277aa6-aea8-4e37-878f-f6e0f186846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01591fa-8c97-462b-888b-ad3ba23648fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-624063475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c76a207-faea-426e-a008-bfc9716b6f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61890cdd5d6424bb90ba5308e03321e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:19Z,use_quota=True,user_id='281f1c3ec633404a9af51e85e9b7ce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9795d140-f3c3-4fb0-8aa6-29970fa5f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9795d140-f3c3-4fb0-8aa6-29970fa5f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26764a4-7b9d-4a66-8d3b-8046573edcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26764a4-7b9d-4a66-8d3b-8046573edcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c76a207-faea-426e-a008-bfc9716b6f89', 'volume_name': 'volume-9c76a207-faea-426e-a008-bfc9716b6f89', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd38f0-335f-4c97-ba7b-9eb1aef45e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd38f0-335f-4c97-ba7b-9eb1aef45e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0067f-50d6-4457-9c7b-0cd10ca7b76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume 9c76a207-faea-426e-a008-bfc9716b6f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c76a207-faea-426e-a008-bfc9716b6f89', 'volume_size': 1}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-624063475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c76a207-faea-426e-a008-bfc9716b6f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61890cdd5d6424bb90ba5308e03321e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:19Z,use_quota=True,user_id='281f1c3ec633404a9af51e85e9b7ce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Creating volume 9c76a207-faea-426e-a008-bfc9716b6f89 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:19 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:19 devstack quobyte-client[83978]: System call of process 97587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:19 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=94, name=volume-9c76a207-faea-426e-a008-bfc9716b6f89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76277aa6-aea8-4e37-878f-f6e0f186846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169612114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07b6ebf-1519-49e2-b3b6-c0c3ef997694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:19Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3984ea57-d2e1-43f4-b592-8d0fda15d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3984ea57-d2e1-43f4-b592-8d0fda15d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ac6f7f-568b-4aa6-bd98-d62b7deb423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ac6f7f-568b-4aa6-bd98-d62b7deb423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07b6ebf-1519-49e2-b3b6-c0c3ef997694', 'volume_name': 'volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf536d-90b2-4e58-a04c-02d85e830631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf536d-90b2-4e58-a04c-02d85e830631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492323e6-faf1-44f3-b18f-9b90a9d99c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:19 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Volume a07b6ebf-1519-49e2-b3b6-c0c3ef997694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694', 'volume_size': 1}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89 1073741824" returned: 0 in 0.374s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89" returned: 0 in 0.076s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] <== create_volume: return (492ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169612114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07b6ebf-1519-49e2-b3b6-c0c3ef997694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6c44ab95dd4a87a8b6a77f7506964e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:19Z,use_quota=True,user_id='dffe30a201004b2585fcad4d10c01993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Creating volume a07b6ebf-1519-49e2-b3b6-c0c3ef997694 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:19 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:20 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=95, name=volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0067f-50d6-4457-9c7b-0cd10ca7b76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c76a207-faea-426e-a008-bfc9716b6f89', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dc6b7d-b304-4276-8183-616654da8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Volume volume-9c76a207-faea-426e-a008-bfc9716b6f89 (9c76a207-faea-426e-a008-bfc9716b6f89): created successfully
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73dc6b7d-b304-4276-8183-616654da8923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Flow 'volume_create_manager' (ab77e3a6-801a-46e6-bc57-a88a0db07c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 1073741824" returned: 0 in 0.400s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-50456a77-f6b3-43e6-9214-5c9e372fe41b tempest-VolumeQuotasAdminTestJSON-412569437 None] Created volume successfully.
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=62,cinder:UPDATE=85,cinder:INSERT=19,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" returned: 0 in 0.266s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492323e6-faf1-44f3-b18f-9b90a9d99c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99283352-cb3c-4ba9-8745-aa8d55847e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Volume volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 (a07b6ebf-1519-49e2-b3b6-c0c3ef997694): created successfully
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99283352-cb3c-4ba9-8745-aa8d55847e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Flow 'volume_create_manager' (5a4cdf54-2171-450a-a5e2-0784862ce4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9148f2fd-b186-436c-86db-8d0b5019ff92 tempest-VolumesActionsTest-194766139 None] Created volume successfully.
Sep 25 19:59:21 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-df87cc66-f39b-420f-bf54-7b11556377b7 tempest-VolumeQuotasAdminTestJSON-339310036 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-a07b6ebf-1519-49e2-b3b6-c0c3ef997694-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-df87cc66-f39b-420f-bf54-7b11556377b7 tempest-VolumeQuotasAdminTestJSON-339310036 None] Transfer volume completed successfully.
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "cinder-a07b6ebf-1519-49e2-b3b6-c0c3ef997694-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:21 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Acquiring lock "cinder-quobyte-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "cinder-quobyte-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" acquired by "delete_volume" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19209e3-8ef1-4dd6-bfc5-a8372ea87e89]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" returned: 0 in 0.420s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" returned: 0 in 0.109s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "cinder-quobyte-a07b6ebf-1519-49e2-b3b6-c0c3ef997694" released by "delete_volume" :: held 0.688s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Created reservations ['01311853-b446-459d-9452-4f10c96a3b24', 'ed190da2-af93-4283-8b49-8d81347a69d4', '3326bc98-31a5-4d9f-80e9-a384846eb187', '3e44cf49-8bac-47ff-9178-a99b497fc033'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Acquiring lock "cinder-9c76a207-faea-426e-a008-bfc9716b6f89-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "cinder-9c76a207-faea-426e-a008-bfc9716b6f89-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.210s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:23 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Deleted volume successfully.
Sep 25 19:59:23 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Acquiring lock "cinder-quobyte-9c76a207-faea-426e-a008-bfc9716b6f89" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "cinder-quobyte-9c76a207-faea-426e-a008-bfc9716b6f89" acquired by "delete_volume" :: waited 0.046s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-007fa747-9944-4b92-ba20-4dd6d7faa7c3 tempest-VolumesActionsTest-194766139 None] Lock "cinder-a07b6ebf-1519-49e2-b3b6-c0c3ef997694-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bfbe5e-4cdc-4531-8a40-1e140ea79644]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89" returned: 0 in 0.382s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9c76a207-faea-426e-a008-bfc9716b6f89" returned: 0 in 0.152s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "cinder-quobyte-9c76a207-faea-426e-a008-bfc9716b6f89" released by "delete_volume" :: held 0.735s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Created reservations ['36bb54c2-5f81-49a9-8c69-91b03d5ef315', '1def95d8-b18d-4cb3-8518-cdbf574cbb9c', 'eda09f5b-e19c-4641-a5a3-dfdfc436f1a3', '56db216c-7ded-4c41-8156-e97bc938c93e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Deleted volume successfully.
Sep 25 19:59:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0047f398-79ae-442b-9d88-e6322b61dd42 tempest-VolumeQuotasAdminTestJSON-2010230800 None] Lock "cinder-9c76a207-faea-426e-a008-bfc9716b6f89-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:34 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Flow 'volume_create_manager' (10ec07c5-600f-472d-814d-d411ea3476bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67af793b-af77-4a13-8954-e8d326c7e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67af793b-af77-4a13-8954-e8d326c7e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-623467012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0510ee54-9519-408e-930c-092701136163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b68c3a0eda4e1182ea9d12a5e2a372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:35Z,use_quota=True,user_id='0529cb7d3d6244b6989244082a529a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb04e40e-f8ea-4a8a-aa5c-02495a6918cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb04e40e-f8ea-4a8a-aa5c-02495a6918cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e8be2f-2b4f-4aa1-a969-f9390e2fb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e8be2f-2b4f-4aa1-a969-f9390e2fb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0510ee54-9519-408e-930c-092701136163', 'volume_name': 'volume-0510ee54-9519-408e-930c-092701136163', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e879361f-a83a-4417-a685-05fd5e57c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e879361f-a83a-4417-a685-05fd5e57c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18de4c3d-e6b8-437e-ada1-384f6b15999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Volume 0510ee54-9519-408e-930c-092701136163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0510ee54-9519-408e-930c-092701136163', 'volume_size': 1}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-623467012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0510ee54-9519-408e-930c-092701136163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b68c3a0eda4e1182ea9d12a5e2a372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:35Z,use_quota=True,user_id='0529cb7d3d6244b6989244082a529a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Creating volume 0510ee54-9519-408e-930c-092701136163 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:35 devstack quobyte-client[83978]: System call of process 97609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=96, name=volume-0510ee54-9519-408e-930c-092701136163, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163 1073741824" returned: 0 in 0.385s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163" returned: 0 in 0.140s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] <== create_volume: return (603ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18de4c3d-e6b8-437e-ada1-384f6b15999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0510ee54-9519-408e-930c-092701136163', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d673f30-f969-49c0-8751-0a56a6847adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Volume volume-0510ee54-9519-408e-930c-092701136163 (0510ee54-9519-408e-930c-092701136163): created successfully
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d673f30-f969-49c0-8751-0a56a6847adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Flow 'volume_create_manager' (10ec07c5-600f-472d-814d-d411ea3476bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b6b86999-7bb5-40aa-bb8f-e611159fe5a4 tempest-VolumeQuotasNegativeTestJSON-294236823 None] Created volume successfully.
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Acquiring lock "cinder-0510ee54-9519-408e-930c-092701136163-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "cinder-0510ee54-9519-408e-930c-092701136163-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Acquiring lock "cinder-quobyte-0510ee54-9519-408e-930c-092701136163" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "cinder-quobyte-0510ee54-9519-408e-930c-092701136163" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca5dd27-d0fb-4d51-94dc-0f3db0e8cf3e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:38 devstack quobyte-client[83978]: System call of process 97615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163" returned: 0 in 0.503s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0510ee54-9519-408e-930c-092701136163" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "cinder-quobyte-0510ee54-9519-408e-930c-092701136163" released by "delete_volume" :: held 0.822s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Created reservations ['b035c039-0d04-4dab-bb8e-da2dfbd01dda', 'e1ca1602-8726-4979-b046-3ec985671f95', '7683d5e2-ccd8-4e34-91e4-c3a42279597b', '8b08f9fc-0dfe-4446-abc7-d4cf1efb626a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.119s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Deleted volume successfully.
Sep 25 19:59:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7ef35e36-4313-45f6-8089-6b197d15ed5c tempest-VolumeQuotasNegativeTestJSON-294236823 None] Lock "cinder-0510ee54-9519-408e-930c-092701136163-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (99c27325-9da6-4992-b058-320be96f140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f980df-e86a-4993-9488-81b010beaeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f980df-e86a-4993-9488-81b010beaeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625309055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4367aed4-184a-4bf3-a8d1-6a4a5ac6960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a5d0d78a304bc4b889f99220688449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:45Z,use_quota=True,user_id='cbcd0f66393f48ef839412d28f0c3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f28da4-cae0-4423-957f-a41b09fd6865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f28da4-cae0-4423-957f-a41b09fd6865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4574ca-1a50-4e54-a870-3577ea0e7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4574ca-1a50-4e54-a870-3577ea0e7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4367aed4-184a-4bf3-a8d1-6a4a5ac6960f', 'volume_name': 'volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4a1cba-d6ff-4658-b5df-8bc6597c83ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4a1cba-d6ff-4658-b5df-8bc6597c83ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd314410-406c-41c3-ad59-cfaf42df0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:45 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f', 'volume_size': 1}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625309055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4367aed4-184a-4bf3-a8d1-6a4a5ac6960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a5d0d78a304bc4b889f99220688449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:45Z,use_quota=True,user_id='cbcd0f66393f48ef839412d28f0c3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Creating volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:45 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:45 devstack quobyte-client[83978]: System call of process 97633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:45 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=97, name=volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f 1073741824" returned: 0 in 0.562s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" returned: 0 in 0.193s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] <== create_volume: return (857ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd314410-406c-41c3-ad59-cfaf42df0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0ec529-e4f6-4765-97d3-1f6d4acbc70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:46 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Volume volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f (4367aed4-184a-4bf3-a8d1-6a4a5ac6960f): created successfully
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0ec529-e4f6-4765-97d3-1f6d4acbc70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (99c27325-9da6-4992-b058-320be96f140d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c7dcb99e-bef2-4c22-9a7e-a053af0f4df9 tempest-VolumesDeleteCascade-1293049314 None] Created volume successfully.
Sep 25 19:59:47 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Flow 'volume_create_manager' (43211481-7c6c-41b7-b235-4163df4819e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90b20ca-63ab-4b26-937f-217c76deabed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90b20ca-63ab-4b26-937f-217c76deabed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-963217126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c850379964483d8ef2583fa6aa3be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:47Z,use_quota=True,user_id='0a29b4c27be740dab7fefeadc2c91885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9f5db14-b609-4822-a53d-c7bcbb5d3834),volume_type_id=b9f5db14-b609-4822-a53d-c7bcbb5d3834)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8161628-aadc-491b-b7b8-68eded2e1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8161628-aadc-491b-b7b8-68eded2e1e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd9d0c6-a4c9-40e3-ac3f-d2c7eef418ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd9d0c6-a4c9-40e3-ac3f-d2c7eef418ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc', 'volume_name': 'volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36132610-f92d-4099-a031-aa9966b34c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36132610-f92d-4099-a031-aa9966b34c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279c2469-40f8-495a-87fa-7bac6aff972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume 0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc', 'volume_size': 1}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T17:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-963217126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c850379964483d8ef2583fa6aa3be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T17:59:47Z,use_quota=True,user_id='0a29b4c27be740dab7fefeadc2c91885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9f5db14-b609-4822-a53d-c7bcbb5d3834),volume_type_id=b9f5db14-b609-4822-a53d-c7bcbb5d3834)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Creating volume 0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 19:59:47 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:47 devstack quobyte-client[83978]: System call of process 97660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:47 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=98, name=volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc 1073741824" returned: 0 in 0.324s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] <== create_volume: return (474ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 19:59:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.485s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279c2469-40f8-495a-87fa-7bac6aff972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1b3eb-0eb4-4ce0-84b0-12ffb9588c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 19:59:48 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc (0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc): created successfully
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1b3eb-0eb4-4ce0-84b0-12ffb9588c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Flow 'volume_create_manager' (43211481-7c6c-41b7-b235-4163df4819e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 19:59:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3db8d31f-8d33-431a-a048-0c8829291c19 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Created volume successfully.
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Creating offline snapshot f2313913-b010-4425-b4f4-511c0c32952b of volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde8e334-f564-4668-8b7a-91f8c5cd816e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" returned: 0 in 0.380s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:49 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=99, name=volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b 1G" returned: 0 in 0.258s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:49 devstack quobyte-client[83978]: System call of process 97678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:49 devstack quobyte-client[83978]: System call of process 97678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img rebase -u -b volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.168s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.373s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.info" returned: 0 in 0.293s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.info" returned: 0 in 0.252s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4145b07a-e799-4e69-8035-967303f55218 tempest-VolumesDeleteCascade-1293049314 None] Create snapshot completed successfully
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.202s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5d5eb2a5-8057-4e6d-9e5d-d0b8bfd4bb48 tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Retype volume completed successfully.
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "cinder-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "cinder-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:51 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "cinder-quobyte-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:51 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "cinder-quobyte-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" acquired by "delete_volume" :: waited 0.029s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Creating offline snapshot eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 of volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63f228-f7fc-4d5c-82d3-58ad31b48601]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b9896-ef49-4f5a-9b8b-d91927252adb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" returned: 0 in 0.477s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.501s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" returned: 0 in 0.245s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "cinder-quobyte-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc" released by "delete_volume" :: held 0.937s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:52 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=101, name=volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 1G" returned: 0 in 0.391s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:52 devstack quobyte-client[83978]: System call of process 97696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:52 devstack quobyte-client[83978]: System call of process 97696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img rebase -u -b volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.243s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 19:59:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:53 devstack cinder-volume[83952]: WARNING cinder.quota [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:59:53 devstack cinder-volume[83952]: WARNING cinder.quota [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.278s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.172s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Created reservations ['accec98b-8876-4609-88c4-352291510baf', '0d7e3f0c-86e2-48a6-a0f2-3be2a4f30a57', '8dec45a4-6cbf-4941-a06c-046cadfc0424', '174f98fc-f397-4ba5-b659-94420e456b63'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-37cc4e43-7be7-4a29-ac46-c281630a6fb7 tempest-VolumesDeleteCascade-1293049314 None] Create snapshot completed successfully
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:53 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Deleted volume successfully.
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dca43501-f26a-41d3-8386-20d8e283cd0d tempest-VolumeRetypeWithoutMigrationTest-334117200 None] Lock "cinder-0877f3a9-70ec-4050-a7a7-f9a7bc1ca8fc-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.314s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Performing cascade delete. {{(pid=83952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Deleting offline snapshot eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 of volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] snapshot_file for this snap is: volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74850e-f38e-4cb2-a362-ca2d5629791a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.445s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1502ec80-94fe-486d-a0d8-45e0384d6d71]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.421s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:56 devstack quobyte-client[83978]: System call of process 97710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:56 devstack quobyte-client[83978]: System call of process 97710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:56 devstack quobyte-client[83978]: System call of process 97710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:56 devstack quobyte-client[83978]: System call of process 97710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.319s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" returned: 0 in 0.117s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3" released by "_delete_snapshot" :: held 1.643s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" released by "delete_snapshot" :: held 1.664s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['c93c9c62-ca92-4972-8413-fcd2659caf1b', 'a30341b9-9836-47ea-8509-6904a302ef2c', 'fc789780-c12e-48ce-93a4-b151bebcfc56', '48ed19dd-656f-4575-a718-ebf88a630f5b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=75,cinder:UPDATE=85,cinder:DELETE=15,cinder:INSERT=22 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 19:59:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Delete snapshot completed successfully.
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-eb9e5799-d34a-4c2d-9697-d6ca1bcdedf3-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-f2313913-b010-4425-b4f4-511c0c32952b-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-f2313913-b010-4425-b4f4-511c0c32952b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:57 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-f2313913-b010-4425-b4f4-511c0c32952b" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-f2313913-b010-4425-b4f4-511c0c32952b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Deleting offline snapshot f2313913-b010-4425-b4f4-511c0c32952b of volume 4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] snapshot_file for this snap is: volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d30094-2d6d-48db-b3cd-08fb4d3caeda]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:58 devstack quobyte-client[83978]: System call of process 97714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.422s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc729eba-6846-46e2-a47b-6c0e94c45603]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:58 devstack quobyte-client[83978]: System call of process 97717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" returned: 0 in 0.437s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:58 devstack quobyte-client[83978]: System call of process 97720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:58 devstack quobyte-client[83978]: System call of process 97720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.237s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f.f2313913-b010-4425-b4f4-511c0c32952b" returned: 0 in 0.142s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-f2313913-b010-4425-b4f4-511c0c32952b" released by "_delete_snapshot" :: held 1.602s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" released by "delete_snapshot" :: held 1.628s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['5ba19b44-dc9d-4b20-9031-36cf221dff51', '810eba40-3495-4da3-9003-22d712148810', '9f6a26c4-df54-4ad9-aff9-baa6a3a0c8b7', '78aa12a3-5515-46bd-95ca-7893f55b0c1d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 19:59:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Delete snapshot completed successfully.
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-f2313913-b010-4425-b4f4-511c0c32952b-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Snapshots deleted, issuing volume delete {{(pid=83952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f9d2d3-fab7-458b-a6fa-b745fedba26e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 19:59:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" returned: 0 in 0.566s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" returned: 0 in 0.121s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f" released by "delete_volume" :: held 0.901s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['599544d6-83cd-43c0-b685-93205cdbcb0f', '8a2e0298-f4ee-4c03-b564-bb2697d7721c', 'a345d651-d5ef-4890-82ee-c0ae4bcaa726', 'afd2329c-5528-4dbd-81f1-306c3a54be79'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Deleted volume successfully.
Sep 25 20:00:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e6d3fd63-1f83-4c03-8b05-a350185f7110 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-4367aed4-184a-4bf3-a8d1-6a4a5ac6960f-delete_volume" released by "delete_volume" :: held 6.625s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (3dca88a7-2a6a-4e77-9d4e-7db1f06e916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4d7e7c-919a-44b2-a817-83adf57cf0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4d7e7c-919a-44b2-a817-83adf57cf0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-374660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd85e130-af62-45be-b1b0-c96f9dcd36ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a5d0d78a304bc4b889f99220688449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:02Z,use_quota=True,user_id='cbcd0f66393f48ef839412d28f0c3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3ce31c-4e7e-46b0-a6cb-ce91f2be9733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3ce31c-4e7e-46b0-a6cb-ce91f2be9733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5464333-b9a4-428a-93b5-2d2c2f03d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5464333-b9a4-428a-93b5-2d2c2f03d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd85e130-af62-45be-b1b0-c96f9dcd36ed', 'volume_name': 'volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f5a2bf-c9b4-4337-bb20-5bcda14e810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f5a2bf-c9b4-4337-bb20-5bcda14e810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c2e5c-466b-46ba-ba2b-825be86a3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:02 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Volume bd85e130-af62-45be-b1b0-c96f9dcd36ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed', 'volume_size': 1}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-374660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd85e130-af62-45be-b1b0-c96f9dcd36ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a5d0d78a304bc4b889f99220688449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:02Z,use_quota=True,user_id='cbcd0f66393f48ef839412d28f0c3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Creating volume bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:02 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:02 devstack quobyte-client[83978]: System call of process 97730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:02 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=102, name=volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed 1073741824" returned: 0 in 0.373s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.612s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c2e5c-466b-46ba-ba2b-825be86a3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4ddf14-2f76-448e-93b8-731ebdea8ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:03 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Volume volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed (bd85e130-af62-45be-b1b0-c96f9dcd36ed): created successfully
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4ddf14-2f76-448e-93b8-731ebdea8ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:03 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (3dca88a7-2a6a-4e77-9d4e-7db1f06e916b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:03 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9b5f8e5e-f87c-42a9-ab84-2030eafd2179 tempest-VolumesDeleteCascade-1293049314 None] Created volume successfully.
Sep 25 20:00:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Creating offline snapshot 3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c of volume bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:00:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[86576211-87a9-4d64-8ce1-fd39cda85c1b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:05 devstack quobyte-client[83978]: System call of process 97734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:05 devstack quobyte-client[83978]: System call of process 97734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:05 devstack quobyte-client[83978]: System call of process 97734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.458s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:05 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=103, name=volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c 1G" returned: 0 in 0.282s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:05 devstack quobyte-client[83978]: System call of process 97740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img rebase -u -b volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.155s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:00:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.200s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.126s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.info" returned: 0 in 0.110s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.info" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:06 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-56bd15d7-76fa-4964-b941-3bbd3d9b1b18 tempest-VolumesDeleteCascade-1293049314 None] Create snapshot completed successfully
Sep 25 20:00:07 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Flow 'volume_create_manager' (932a7ead-b858-45a6-8c9f-bd675c9673df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893a13ce-a5cc-4868-ad5a-f3dda60034ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893a13ce-a5cc-4868-ad5a-f3dda60034ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-792570484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24247e45-66d6-4993-b72b-8b0804221fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcf034483884aa7a46b4a37afd40a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:07Z,use_quota=True,user_id='fc827e7c943f4ea6997727321cf1c895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c7f3904-9210-4dd5-b0de-f5f30dc3ff8b),volume_type_id=1c7f3904-9210-4dd5-b0de-f5f30dc3ff8b)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c244cff9-1f29-4bc0-bcae-439a1440d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c244cff9-1f29-4bc0-bcae-439a1440d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ae4409-14d7-404d-9826-a606921c2420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ae4409-14d7-404d-9826-a606921c2420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24247e45-66d6-4993-b72b-8b0804221fed', 'volume_name': 'volume-24247e45-66d6-4993-b72b-8b0804221fed', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05433df7-e7f9-4b60-a0b0-eb56eb025259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05433df7-e7f9-4b60-a0b0-eb56eb025259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaada5bf-f819-4fc8-9769-91ea27d43011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Volume 24247e45-66d6-4993-b72b-8b0804221fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24247e45-66d6-4993-b72b-8b0804221fed', 'volume_size': 1}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-792570484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24247e45-66d6-4993-b72b-8b0804221fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcf034483884aa7a46b4a37afd40a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:07Z,use_quota=True,user_id='fc827e7c943f4ea6997727321cf1c895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c7f3904-9210-4dd5-b0de-f5f30dc3ff8b),volume_type_id=1c7f3904-9210-4dd5-b0de-f5f30dc3ff8b)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Creating volume 24247e45-66d6-4993-b72b-8b0804221fed {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:07 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:07 devstack quobyte-client[83978]: System call of process 97748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:07 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=105, name=volume-24247e45-66d6-4993-b72b-8b0804221fed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed 1073741824" returned: 0 in 0.355s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.566s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaada5bf-f819-4fc8-9769-91ea27d43011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24247e45-66d6-4993-b72b-8b0804221fed', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb4e2c9-18dc-4bd5-80f1-3ee5e0bdac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Volume volume-24247e45-66d6-4993-b72b-8b0804221fed (24247e45-66d6-4993-b72b-8b0804221fed): created successfully
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb4e2c9-18dc-4bd5-80f1-3ee5e0bdac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Flow 'volume_create_manager' (932a7ead-b858-45a6-8c9f-bd675c9673df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0f88c4d9-1b6e-40df-b0aa-662d847ab5d6 tempest-VolumeTypesAccessTest-423409795 None] Created volume successfully.
Sep 25 20:00:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (7019df59-3df1-461d-bee0-4857bab8c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc294f2-4c97-41f1-87b3-c923521965a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc294f2-4c97-41f1-87b3-c923521965a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1245628261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f27ff03-82f4-4d0f-8292-8aec57becd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a5d0d78a304bc4b889f99220688449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:09Z,use_quota=True,user_id='cbcd0f66393f48ef839412d28f0c3bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d7361-8583-4a7e-9d31-623b46a74e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d7361-8583-4a7e-9d31-623b46a74e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0fc67b-46a4-4eba-b63d-df2eed8459ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0fc67b-46a4-4eba-b63d-df2eed8459ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f27ff03-82f4-4d0f-8292-8aec57becd6f', 'volume_name': 'volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f', 'volume_size': 1, 'snapshot_id': '3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8900fc7-6c63-4d54-a6c9-2ec00e0090c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8900fc7-6c63-4d54-a6c9-2ec00e0090c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c22a806-aa88-4608-bece-acf3afed77d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:08 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Volume 9f27ff03-82f4-4d0f-8292-8aec57becd6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f', 'volume_size': 1, 'snapshot_id': '3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c'}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-9f27ff03-82f4-4d0f-8292-8aec57becd6f" by "_create_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-9f27ff03-82f4-4d0f-8292-8aec57becd6f" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Creating volume 9f27ff03-82f4-4d0f-8292-8aec57becd6f from snapshot 3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" by "_copy_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] snapshot: 3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c, volume: 9f27ff03-82f4-4d0f-8292-8aec57becd6f,  {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e3b100-c888-46fe-bf82-e787c88d4c64]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:09 devstack quobyte-client[83978]: System call of process 97752 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.406s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Creating direct copy from snapshot {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Acquiring lock "cinder-24247e45-66d6-4993-b72b-8b0804221fed-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b711d-3f8e-462c-bdbd-088ea627c34c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "cinder-24247e45-66d6-4993-b72b-8b0804221fed-delete_volume" acquired by "delete_volume" :: waited 0.251s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Acquiring lock "cinder-quobyte-24247e45-66d6-4993-b72b-8b0804221fed" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "cinder-quobyte-24247e45-66d6-4993-b72b-8b0804221fed" acquired by "delete_volume" :: waited 0.027s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.555s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG cinder.utils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f not found in is_blk_device check {{(pid=83952) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf727a73-6578-4f7e-8b32-e37b26d9a536]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:10 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=106, name=volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:11 devstack quobyte-client[83978]: System call of process 97761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:11 devstack quobyte-client[83978]: System call of process 97761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed" returned: 0 in 0.960s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-24247e45-66d6-4993-b72b-8b0804221fed" returned: 0 in 0.402s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "cinder-quobyte-24247e45-66d6-4993-b72b-8b0804221fed" released by "delete_volume" :: held 2.077s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:12 devstack cinder-volume[83952]: WARNING cinder.quota [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2048784787 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2048784787, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:00:12 devstack cinder-volume[83952]: WARNING cinder.quota [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2048784787 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2048784787, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Created reservations ['8bcd7dc6-ddb5-4e3d-9484-31e86af412ad', 'fcb5121b-3c6c-497e-9c4a-83690f2bb58f', '8823239d-c62b-4fce-aad0-30debf7cfb4a', 'b27ab242-aaf7-4e50-b23c-0f5fc18ae20b'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.349s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:14 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Deleted volume successfully.
Sep 25 20:00:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5a4b2be6-232e-4491-a3fa-796ac6fa2c29 tempest-VolumeTypesAccessTest-423409795 None] Lock "cinder-24247e45-66d6-4993-b72b-8b0804221fed-delete_volume" released by "delete_volume" :: held 5.430s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f" returned: 0 in 5.900s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f446a8-dff0-482d-b0ed-cbb855fb7bdd]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.576s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:00:16 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Converted 1024.00 MB image at 173.47 MB/s
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f" returned: 0 in 0.106s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" released by "_copy_volume_from_snapshot" :: held 7.969s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-9f27ff03-82f4-4d0f-8292-8aec57becd6f" released by "_create_volume_from_snapshot" :: held 8.005s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c22a806-aa88-4608-bece-acf3afed77d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f', 'volume_size': 1, 'snapshot_id': '3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a0bc67-3bdf-49c9-9b6d-9456d628ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Volume volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f (9f27ff03-82f4-4d0f-8292-8aec57becd6f): created successfully
Sep 25 20:00:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a0bc67-3bdf-49c9-9b6d-9456d628ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Flow 'volume_create_manager' (7019df59-3df1-461d-bee0-4857bab8c62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7b0fa052-b67f-482f-a843-645c553c4561 tempest-VolumesDeleteCascade-1293049314 None] Created volume successfully.
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-bd85e130-af62-45be-b1b0-c96f9dcd36ed-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-bd85e130-af62-45be-b1b0-c96f9dcd36ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Performing cascade delete. {{(pid=83952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:18 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Deleting offline snapshot 3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c of volume bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] snapshot_file for this snap is: volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda58221-f480-4087-8ee4-14e5e344c497]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:19 devstack quobyte-client[83978]: System call of process 97779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.460s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[34941d93-a068-422f-a446-0f74576c759d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:19 devstack quobyte-client[83978]: System call of process 97782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.488s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:19 devstack quobyte-client[83978]: System call of process 97785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.234s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed.3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c" released by "_delete_snapshot" :: held 1.593s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" released by "delete_snapshot" :: held 1.620s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['ccac07bf-6732-469d-b977-7cac32294806', 'bf13225b-6061-4d67-93d8-d9787dc9ffff', '1cc402e6-ff2a-4d40-9c8d-e3206bf994ec', '8216f9a1-65e8-45b7-a73a-8f99d615bf5d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Delete snapshot completed successfully.
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-3a059cf8-ad41-4882-a4ab-7b2e4cdf0d1c-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Snapshots deleted, issuing volume delete {{(pid=83952) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade38dc-fdd2-4d8e-9062-33be5b92efa2]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.484s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bd85e130-af62-45be-b1b0-c96f9dcd36ed" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-bd85e130-af62-45be-b1b0-c96f9dcd36ed" released by "delete_volume" :: held 0.784s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=96,cinder:DELETE=5,cinder:SELECT=72,cinder:INSERT=22 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:00:21 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['a0ffac3f-5867-435a-96af-917207c33622', 'e2cd6a8a-34d5-4c51-9da7-8ba4aaf64ea1', '23eb4e9e-ef05-4c4b-b281-23053ca23fbf', 'c19a0219-3cf6-4fb8-997b-e498cf85a38f'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.086s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Deleted volume successfully.
Sep 25 20:00:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3b59b7b0-7323-43a8-b7b9-46529a3cbcdd tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-bd85e130-af62-45be-b1b0-c96f9dcd36ed-delete_volume" released by "delete_volume" :: held 4.061s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-9f27ff03-82f4-4d0f-8292-8aec57becd6f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-9f27ff03-82f4-4d0f-8292-8aec57becd6f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:23 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e6921-992c-4c6b-a280-5788c910bf12]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:23 devstack quobyte-client[83978]: System call of process 97794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f" returned: 0 in 0.447s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9f27ff03-82f4-4d0f-8292-8aec57becd6f" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-quobyte-9f27ff03-82f4-4d0f-8292-8aec57becd6f" released by "delete_volume" :: held 0.735s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Created reservations ['7c09de41-ccec-4262-a7b8-ef9f850c6ed2', '9d4ed893-aa86-4601-9356-ce224d5612e0', 'f83950ee-9a76-47a8-b640-956444ae8483', '2245cfaf-8061-42bb-a5ae-0e2afd26a819'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Deleted volume successfully.
Sep 25 20:00:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-cc614330-6241-47c5-bf62-8210e3904847 tempest-VolumesDeleteCascade-1293049314 None] Lock "cinder-9f27ff03-82f4-4d0f-8292-8aec57becd6f-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Flow 'volume_create_manager' (874be0e3-3c00-4b21-9c4a-2d09543a535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdffb3f-26c3-4057-a0f5-163f5a73422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdffb3f-26c3-4057-a0f5-163f5a73422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-316451328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ad7c37-7616-4524-8dbf-7f1e282f21bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42afe5b8c07b402e83ad068fb0f5a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:26Z,use_quota=True,user_id='66bf267d35d24004b93d9802b432ca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5ca7af-72df-4bd2-9622-d52d7a8dabf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5ca7af-72df-4bd2-9622-d52d7a8dabf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce873e5b-b90e-4f47-87df-d7cd7e9dbec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce873e5b-b90e-4f47-87df-d7cd7e9dbec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ad7c37-7616-4524-8dbf-7f1e282f21bf', 'volume_name': 'volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e758492b-e064-4be1-afd9-b65e12a15ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e758492b-e064-4be1-afd9-b65e12a15ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d2e719-295e-459c-ae5a-7bc7e5f00b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:26 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Volume f4ad7c37-7616-4524-8dbf-7f1e282f21bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf', 'volume_size': 1}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-316451328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ad7c37-7616-4524-8dbf-7f1e282f21bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42afe5b8c07b402e83ad068fb0f5a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:26Z,use_quota=True,user_id='66bf267d35d24004b93d9802b432ca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Creating volume f4ad7c37-7616-4524-8dbf-7f1e282f21bf {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:26 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:26 devstack quobyte-client[83978]: System call of process 97800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:26 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=107, name=volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf 1073741824" returned: 0 in 0.396s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" returned: 0 in 0.121s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] <== create_volume: return (618ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d2e719-295e-459c-ae5a-7bc7e5f00b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571cb5e5-9e24-4621-9cee-a2c3b478ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:27 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Volume volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf (f4ad7c37-7616-4524-8dbf-7f1e282f21bf): created successfully
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571cb5e5-9e24-4621-9cee-a2c3b478ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Flow 'volume_create_manager' (874be0e3-3c00-4b21-9c4a-2d09543a535d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:27 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e75ac199-7ddb-41f3-a95b-f7ade1f9bd8c tempest-VolumesTransfersV355Test-319293800 None] Created volume successfully.
Sep 25 20:00:28 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Flow 'volume_create_manager' (01993099-5fa3-4217-8f9b-36d456262001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadbec9c-67fb-4dde-9f38-fa93dbdeb617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadbec9c-67fb-4dde-9f38-fa93dbdeb617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2137825076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9d964a-1a7d-42b8-a24a-67e48fb589b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f192add3ebd4b1caa407403c4b827ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:28Z,use_quota=True,user_id='2a6122719712424b9334a608c601493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6078cf-59ee-4397-9448-7cb8de050bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6078cf-59ee-4397-9448-7cb8de050bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca6813-4716-4317-b1b3-fb2c70f10378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca6813-4716-4317-b1b3-fb2c70f10378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9d964a-1a7d-42b8-a24a-67e48fb589b9', 'volume_name': 'volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9d4e14-905d-4969-aa05-f1c722828e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9d4e14-905d-4969-aa05-f1c722828e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d93fba-444b-4437-a7d6-6a5115a3a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:28 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Volume bf9d964a-1a7d-42b8-a24a-67e48fb589b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9', 'volume_size': 1}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2137825076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9d964a-1a7d-42b8-a24a-67e48fb589b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f192add3ebd4b1caa407403c4b827ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:28Z,use_quota=True,user_id='2a6122719712424b9334a608c601493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Creating volume bf9d964a-1a7d-42b8-a24a-67e48fb589b9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:28 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:28 devstack quobyte-client[83978]: System call of process 97804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:28 devstack quobyte-client[83978]: System call of process 97804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:28 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=108, name=volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 1073741824" returned: 0 in 0.355s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" returned: 0 in 0.089s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b8d119e6-6a89-4603-9f68-7862624dc531 tempest-VolumesTransfersV355Test-1951163688 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d93fba-444b-4437-a7d6-6a5115a3a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5976c611-0062-4f76-86b7-daf3e4ec5b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b8d119e6-6a89-4603-9f68-7862624dc531 tempest-VolumesTransfersV355Test-1951163688 None] Transfer volume completed successfully.
Sep 25 20:00:29 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Volume volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 (bf9d964a-1a7d-42b8-a24a-67e48fb589b9): created successfully
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5976c611-0062-4f76-86b7-daf3e4ec5b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Flow 'volume_create_manager' (01993099-5fa3-4217-8f9b-36d456262001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-33925804-3aab-406c-a81e-3c4b1bc124a3 tempest-VolumesMetadataTest-1546837474 None] Created volume successfully.
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "cinder-f4ad7c37-7616-4524-8dbf-7f1e282f21bf-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-f4ad7c37-7616-4524-8dbf-7f1e282f21bf-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "cinder-quobyte-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-quobyte-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd6641f-94c5-40c7-814a-6df645ef7623]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:31 devstack quobyte-client[83978]: System call of process 97808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:31 devstack quobyte-client[83978]: System call of process 97808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:31 devstack quobyte-client[83978]: System call of process 97808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:31 devstack quobyte-client[83978]: System call of process 97808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" returned: 0 in 0.485s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-quobyte-f4ad7c37-7616-4524-8dbf-7f1e282f21bf" released by "delete_volume" :: held 0.803s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Acquiring lock "cinder-bf9d964a-1a7d-42b8-a24a-67e48fb589b9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Created reservations ['8aa20ba8-418f-43d4-aa56-49c4c88782f1', 'd81505a6-f12d-4d30-9613-fcc41a73fedc', '63497592-a8b9-4644-8111-cf28564aaf58', '229f8a27-3e28-4652-91de-be5138f66fd6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "cinder-bf9d964a-1a7d-42b8-a24a-67e48fb589b9-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Acquiring lock "cinder-quobyte-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "cinder-quobyte-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[191f81fb-a4c7-4676-af8d-3e0ba0c15902]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Deleted volume successfully.
Sep 25 20:00:32 devstack quobyte-client[83978]: System call of process 97812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8c21f2a5-05b0-4114-902e-f6cf0f7c6773 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-f4ad7c37-7616-4524-8dbf-7f1e282f21bf-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" returned: 0 in 0.618s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "cinder-quobyte-bf9d964a-1a7d-42b8-a24a-67e48fb589b9" released by "delete_volume" :: held 0.850s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Created reservations ['a1571b56-099c-4280-9e29-d97651c13cff', '77eec54c-1810-4166-81cb-c651a8b3c214', 'ce3c9057-4864-4d5a-9756-6fa66ab6784b', '6d1a3cb6-98fa-431e-9417-6e878c7bd320'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Deleted volume successfully.
Sep 25 20:00:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Flow 'volume_create_manager' (254c17e7-1e71-41f2-836d-4418cbb66345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f56e6c-24d7-4eb3-9423-7ab205e2d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-40a41a8f-fe3e-48f1-83f8-dad935c84232 tempest-VolumesMetadataTest-1546837474 None] Lock "cinder-bf9d964a-1a7d-42b8-a24a-67e48fb589b9-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f56e6c-24d7-4eb3-9423-7ab205e2d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-784499420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fec415-917c-430a-a765-14cbc92c9f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42afe5b8c07b402e83ad068fb0f5a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:33Z,use_quota=True,user_id='66bf267d35d24004b93d9802b432ca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd96b24-492e-44ac-ac41-a748344830a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd96b24-492e-44ac-ac41-a748344830a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d951bd76-38c7-4b52-8eae-925ddf4c1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d951bd76-38c7-4b52-8eae-925ddf4c1666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fec415-917c-430a-a765-14cbc92c9f30', 'volume_name': 'volume-72fec415-917c-430a-a765-14cbc92c9f30', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1c1458-c57d-41c1-b88a-8512d8675196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1c1458-c57d-41c1-b88a-8512d8675196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f09ee-715c-477f-a79b-128cde2ade4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Volume 72fec415-917c-430a-a765-14cbc92c9f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fec415-917c-430a-a765-14cbc92c9f30', 'volume_size': 1}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-784499420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fec415-917c-430a-a765-14cbc92c9f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42afe5b8c07b402e83ad068fb0f5a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:33Z,use_quota=True,user_id='66bf267d35d24004b93d9802b432ca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Creating volume 72fec415-917c-430a-a765-14cbc92c9f30 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:34 devstack quobyte-client[83978]: System call of process 97818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:34 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=109, name=volume-72fec415-917c-430a-a765-14cbc92c9f30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30 1073741824" returned: 0 in 0.374s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] <== create_volume: return (603ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f09ee-715c-477f-a79b-128cde2ade4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fec415-917c-430a-a765-14cbc92c9f30', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c871a3a9-1765-486a-85df-5307bacdcd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Volume volume-72fec415-917c-430a-a765-14cbc92c9f30 (72fec415-917c-430a-a765-14cbc92c9f30): created successfully
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c871a3a9-1765-486a-85df-5307bacdcd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Flow 'volume_create_manager' (254c17e7-1e71-41f2-836d-4418cbb66345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-390764f4-5f65-47db-a1cb-cd14c1a1734e tempest-VolumesTransfersV355Test-319293800 None] Created volume successfully.
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "cinder-72fec415-917c-430a-a765-14cbc92c9f30-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-72fec415-917c-430a-a765-14cbc92c9f30-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:36 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "cinder-quobyte-72fec415-917c-430a-a765-14cbc92c9f30" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-quobyte-72fec415-917c-430a-a765-14cbc92c9f30" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[56639945-8c91-44ce-9a3f-e736bea1de73]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:36 devstack quobyte-client[83978]: System call of process 97823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30" returned: 0 in 0.437s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-72fec415-917c-430a-a765-14cbc92c9f30" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-quobyte-72fec415-917c-430a-a765-14cbc92c9f30" released by "delete_volume" :: held 0.726s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Created reservations ['3d628a71-6224-4b5e-a29b-1965a5f66b83', 'e5920058-d748-43b4-9787-c7bee690e4b3', 'a1a0fd3d-fe89-499c-be7d-6122624b5898', 'e3b6b57e-7fa1-4fa4-8f42-29bef1b691fb'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.117s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Deleted volume successfully.
Sep 25 20:00:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-7a5ad3ea-24c2-47ee-8538-b6f31e81bfb4 tempest-VolumesTransfersV355Test-702152011 None] Lock "cinder-72fec415-917c-430a-a765-14cbc92c9f30-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Flow 'volume_create_manager' (81ee93fa-56fd-4c3e-8a20-6d7fb3fc8503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f520ab-ce82-4cb7-b117-ce87a5cff303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f520ab-ce82-4cb7-b117-ce87a5cff303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1046352200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a701575-fe87-4a55-b52f-e4e01a0870df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9534055bd0941b290639f34030c712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:39Z,use_quota=True,user_id='ddb4d719b14742899134f6dff1440f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e585a-e8a5-4903-9037-9218dc40be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7e585a-e8a5-4903-9037-9218dc40be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8915dc-20b9-4636-8944-bbecde7dcfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8915dc-20b9-4636-8944-bbecde7dcfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a701575-fe87-4a55-b52f-e4e01a0870df', 'volume_name': 'volume-7a701575-fe87-4a55-b52f-e4e01a0870df', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48792e0-1331-4f41-8f25-e0505eef53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48792e0-1331-4f41-8f25-e0505eef53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2112258a-e276-4e9e-a97f-7ff8c7140d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Volume 7a701575-fe87-4a55-b52f-e4e01a0870df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a701575-fe87-4a55-b52f-e4e01a0870df', 'volume_size': 1}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1046352200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a701575-fe87-4a55-b52f-e4e01a0870df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9534055bd0941b290639f34030c712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:39Z,use_quota=True,user_id='ddb4d719b14742899134f6dff1440f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Creating volume 7a701575-fe87-4a55-b52f-e4e01a0870df {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:38 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:39 devstack quobyte-client[83978]: System call of process 97828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:39 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=110, name=volume-7a701575-fe87-4a55-b52f-e4e01a0870df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df 1073741824" returned: 0 in 0.348s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] <== create_volume: return (512ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.524s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2112258a-e276-4e9e-a97f-7ff8c7140d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a701575-fe87-4a55-b52f-e4e01a0870df', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da84ab5f-2ca4-4b6f-b178-710bbc9f346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Volume volume-7a701575-fe87-4a55-b52f-e4e01a0870df (7a701575-fe87-4a55-b52f-e4e01a0870df): created successfully
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da84ab5f-2ca4-4b6f-b178-710bbc9f346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Flow 'volume_create_manager' (81ee93fa-56fd-4c3e-8a20-6d7fb3fc8503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-52e52a3f-8dd1-4666-81b2-d752ffcdf43f tempest-VolumesTransfersTest-1523794372 None] Created volume successfully.
Sep 25 20:00:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5675ce17-7619-4440-9d9e-ce8d0df91a8d tempest-VolumesTransfersTest-280564892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5675ce17-7619-4440-9d9e-ce8d0df91a8d tempest-VolumesTransfersTest-280564892 None] Transfer volume completed successfully.
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "cinder-7a701575-fe87-4a55-b52f-e4e01a0870df-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-7a701575-fe87-4a55-b52f-e4e01a0870df-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "cinder-quobyte-7a701575-fe87-4a55-b52f-e4e01a0870df" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-quobyte-7a701575-fe87-4a55-b52f-e4e01a0870df" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30437e5-dc9c-4719-bd25-96aeeed0e50a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df" returned: 0 in 0.445s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7a701575-fe87-4a55-b52f-e4e01a0870df" returned: 0 in 0.120s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-quobyte-7a701575-fe87-4a55-b52f-e4e01a0870df" released by "delete_volume" :: held 0.728s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Created reservations ['6b39f10f-73dc-401d-8ed6-e6a3eb8c72cd', 'ae8450cb-f615-4c67-970c-98aa1cb9a6e3', '8ba0e9e4-2832-48e4-ae63-2b741132e2b3', '9e5144c9-f8d5-457a-b85c-d182a906e277'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.129s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:44 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Deleted volume successfully.
Sep 25 20:00:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a71b14d8-3146-4d91-864f-00f9baa23d76 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-7a701575-fe87-4a55-b52f-e4e01a0870df-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:45 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Flow 'volume_create_manager' (436fb967-08b1-49fa-8d67-0a76dd1e8e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f47a1d-f4be-41ec-8054-0cd6d46b63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f47a1d-f4be-41ec-8054-0cd6d46b63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-291195439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de2c727-c7fb-424f-8fa2-0a8997db5f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9534055bd0941b290639f34030c712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:46Z,use_quota=True,user_id='ddb4d719b14742899134f6dff1440f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b7bda-7957-4430-bfa3-727e4e262ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b7bda-7957-4430-bfa3-727e4e262ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1ce42-bf94-48cb-8425-6f77ee46d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1ce42-bf94-48cb-8425-6f77ee46d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de2c727-c7fb-424f-8fa2-0a8997db5f48', 'volume_name': 'volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b27dfd-70f9-46c2-9e21-4e757c91882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b27dfd-70f9-46c2-9e21-4e757c91882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1d965c-87c2-49ee-a0a8-d20f56c82240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:46 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Volume 6de2c727-c7fb-424f-8fa2-0a8997db5f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48', 'volume_size': 1}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-291195439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de2c727-c7fb-424f-8fa2-0a8997db5f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9534055bd0941b290639f34030c712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:46Z,use_quota=True,user_id='ddb4d719b14742899134f6dff1440f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Creating volume 6de2c727-c7fb-424f-8fa2-0a8997db5f48 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:46 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:46 devstack quobyte-client[83978]: System call of process 97840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:46 devstack quobyte-client[83978]: System call of process 97840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:46 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=111, name=volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 1073741824" returned: 0 in 0.484s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48" returned: 0 in 0.146s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] <== create_volume: return (719ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1d965c-87c2-49ee-a0a8-d20f56c82240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7847a79-7dd3-4afa-803d-40e641bc49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:47 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Volume volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 (6de2c727-c7fb-424f-8fa2-0a8997db5f48): created successfully
Sep 25 20:00:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7847a79-7dd3-4afa-803d-40e641bc49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:47 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Flow 'volume_create_manager' (436fb967-08b1-49fa-8d67-0a76dd1e8e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c60dba79-7ef8-4c34-be19-9791ec9c84f3 tempest-VolumesTransfersTest-1523794372 None] Created volume successfully.
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "cinder-6de2c727-c7fb-424f-8fa2-0a8997db5f48-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-6de2c727-c7fb-424f-8fa2-0a8997db5f48-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "cinder-quobyte-6de2c727-c7fb-424f-8fa2-0a8997db5f48" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-quobyte-6de2c727-c7fb-424f-8fa2-0a8997db5f48" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eccc2e-f1eb-49d9-a624-c0781ca3517f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:00:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:49 devstack quobyte-client[83978]: System call of process 97884 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48" returned: 0 in 0.492s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-6de2c727-c7fb-424f-8fa2-0a8997db5f48" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-quobyte-6de2c727-c7fb-424f-8fa2-0a8997db5f48" released by "delete_volume" :: held 0.758s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Created reservations ['028bfa1e-42db-4599-80ec-50dfea5048d1', '5b045a98-1c86-4193-b5dc-b20e2eb11812', 'c8da9b30-989a-4f31-a49f-0f86f5e3b799', 'ebdec3f8-53b3-4bb6-af57-9abac095247a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.090s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:50 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Deleted volume successfully.
Sep 25 20:00:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0c8c9c75-5fd7-43b4-b8d2-3b8bab90c231 tempest-VolumesTransfersTest-1297550799 None] Lock "cinder-6de2c727-c7fb-424f-8fa2-0a8997db5f48-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:00:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Flow 'volume_create_manager' (3b78edfa-5feb-4766-9ed5-deb3e2e22711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a5ede9-6cdf-49b2-adcb-199773e75beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a5ede9-6cdf-49b2-adcb-199773e75beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1291270510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9594e2-a169-4f39-9e8f-7ed367f513d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74e7df3f724c758430f8ae0db6deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:55Z,use_quota=True,user_id='716a173ce03e494b896d17b2192313cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae99e56-0538-4458-b4ab-94e6239aa683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae99e56-0538-4458-b4ab-94e6239aa683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff520e1-3293-4fe5-8503-4d41419ed38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff520e1-3293-4fe5-8503-4d41419ed38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9594e2-a169-4f39-9e8f-7ed367f513d0', 'volume_name': 'volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebc6f5f-6571-4711-933b-b6ba0b6357d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebc6f5f-6571-4711-933b-b6ba0b6357d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918c6e01-7729-4c78-9d51-155c136d364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0', 'volume_size': 1}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1291270510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9594e2-a169-4f39-9e8f-7ed367f513d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a74e7df3f724c758430f8ae0db6deca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:55Z,use_quota=True,user_id='716a173ce03e494b896d17b2192313cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Creating volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:55 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:55 devstack quobyte-client[83978]: System call of process 97890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:55 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=112, name=volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 1073741824" returned: 0 in 0.451s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] <== create_volume: return (667ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918c6e01-7729-4c78-9d51-155c136d364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa69e2b-c669-441c-ab58-bfd567e631d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:56 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Volume volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 (0d9594e2-a169-4f39-9e8f-7ed367f513d0): created successfully
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa69e2b-c669-441c-ab58-bfd567e631d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:56 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Flow 'volume_create_manager' (3b78edfa-5feb-4766-9ed5-deb3e2e22711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:56 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-113aa08b-36a5-435d-8b88-eeee09a16ec2 tempest-VolumesActionsTest-1756648170 None] Created volume successfully.
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=73,cinder:UPDATE=98,cinder:INSERT=19,cinder:DELETE=11 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:00:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Flow 'volume_create_manager' (74728227-593a-4df9-ab5e-09b887d91578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc8a50a-bab9-48cf-bd62-0207c80464dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc8a50a-bab9-48cf-bd62-0207c80464dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-577638785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a49bdf-4191-455b-995e-8fd8ab7f2016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4ce14fae074978b4a22ffa0cdbf2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:59Z,use_quota=True,user_id='543e3a89b261439fa2ffb718d1a6e96d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f943-d4d7-4f13-94a9-9777740b8343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f943-d4d7-4f13-94a9-9777740b8343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ca2c43-6b8a-4250-990e-2b0ca63b4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ca2c43-6b8a-4250-990e-2b0ca63b4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a49bdf-4191-455b-995e-8fd8ab7f2016', 'volume_name': 'volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016', 'volume_size': 2}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee7edd2-8314-4885-a36e-b061409bdf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee7edd2-8314-4885-a36e-b061409bdf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea90f2-7421-49b0-aa86-8c6fd9ff2fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:00:59 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Volume c7a49bdf-4191-455b-995e-8fd8ab7f2016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016', 'volume_size': 2}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-577638785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a49bdf-4191-455b-995e-8fd8ab7f2016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4ce14fae074978b4a22ffa0cdbf2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:00:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:00:59Z,use_quota=True,user_id='543e3a89b261439fa2ffb718d1a6e96d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Creating volume c7a49bdf-4191-455b-995e-8fd8ab7f2016 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:00:59 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 2147483648 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:59 devstack quobyte-client[83978]: System call of process 97895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:00:59 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=113, name=volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 2147483648" returned: 0 in 0.437s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016" returned: 0 in 0.089s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] <== create_volume: return (588ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:00:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea90f2-7421-49b0-aa86-8c6fd9ff2fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016', 'volume_size': 2}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b758f0-6ec3-48e5-8d84-ece070cfae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:00 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Volume volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 (c7a49bdf-4191-455b-995e-8fd8ab7f2016): created successfully
Sep 25 20:01:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b758f0-6ec3-48e5-8d84-ece070cfae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:00 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Flow 'volume_create_manager' (74728227-593a-4df9-ab5e-09b887d91578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:01:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-12c3ae5d-ee5d-4065-a5eb-2b5b5b55a37e tempest-VolumesCloneNegativeTest-1353317006 None] Created volume successfully.
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Acquiring lock "cinder-c7a49bdf-4191-455b-995e-8fd8ab7f2016-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "cinder-c7a49bdf-4191-455b-995e-8fd8ab7f2016-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Acquiring lock "cinder-quobyte-c7a49bdf-4191-455b-995e-8fd8ab7f2016" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "cinder-quobyte-c7a49bdf-4191-455b-995e-8fd8ab7f2016" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acedea6-52d5-4111-a00e-8137242e8566]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:01:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016" returned: 0 in 0.447s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c7a49bdf-4191-455b-995e-8fd8ab7f2016" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "cinder-quobyte-c7a49bdf-4191-455b-995e-8fd8ab7f2016" released by "delete_volume" :: held 0.716s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Created reservations ['6a1d0348-9235-4ae2-8706-086ecce7e960', 'c8a14600-579b-4023-bc48-7a4d523b668c', 'c120ba27-6fba-40aa-bd0a-b81b0e15bd32', '53cd4d66-9b96-4a9f-b49c-929aee64fef3'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.077s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:02 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:01:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Deleted volume successfully.
Sep 25 20:01:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bf5dd687-358c-46f4-8418-7e5c6da8ed48 tempest-VolumesCloneNegativeTest-1353317006 None] Lock "cinder-c7a49bdf-4191-455b-995e-8fd8ab7f2016-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Flow 'volume_create_manager' (d260628b-92fe-4784-b595-31f9f9967223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787d883c-ebcb-447c-8704-ff5a46320281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787d883c-ebcb-447c-8704-ff5a46320281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1065874848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f524714d2369403a8acc700ed803102a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:01:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:01:10Z,use_quota=True,user_id='a10cd9ae7dc343d99e19a6517a35a10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b0384-8ae6-4b64-a61b-cdd97bec8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b0384-8ae6-4b64-a61b-cdd97bec8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1b7b0e-293d-49ba-b38e-fc7d5d312440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1b7b0e-293d-49ba-b38e-fc7d5d312440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd', 'volume_name': 'volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd', 'volume_size': 2}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7efb3b6-9d8c-423b-be43-27f99a148db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7efb3b6-9d8c-423b-be43-27f99a148db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba701a82-492b-47b1-b077-1b860203f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:10 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume 9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd', 'volume_size': 2}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1065874848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f524714d2369403a8acc700ed803102a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:01:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:01:10Z,use_quota=True,user_id='a10cd9ae7dc343d99e19a6517a35a10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Creating volume 9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:01:10 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:01:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd 2147483648 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:10 devstack quobyte-client[83978]: System call of process 97926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:10 devstack quobyte-client[83978]: System call of process 97926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:10 devstack quobyte-client[83978]: System call of process 97926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:10 devstack quobyte-client[83978]: System call of process 97926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:10 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=114, name=volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd 2147483648" returned: 0 in 0.632s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba701a82-492b-47b1-b077-1b860203f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd', 'volume_size': 2}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea99fd-f067-4be5-98c0-8963cb7bd0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:01:11 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd (9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd): created successfully
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea99fd-f067-4be5-98c0-8963cb7bd0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:01:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Flow 'volume_create_manager' (d260628b-92fe-4784-b595-31f9f9967223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:01:11 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-36b3b00a-24f4-45a1-a012-57bb2b2e270f tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Created volume successfully.
Sep 25 20:01:12 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:12 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Creating offline snapshot 165a865a-f223-4191-90a4-8f29ae0bf275 of volume 9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d0de6a-7913-40fc-bcdf-41ebc69aad52]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:13 devstack quobyte-client[83978]: System call of process 97938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:13 devstack quobyte-client[83978]: System call of process 97938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:13 devstack quobyte-client[83978]: System call of process 97938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:13 devstack quobyte-client[83978]: System call of process 97938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" returned: 0 in 0.494s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 2G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:13 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=115, name=volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 2G" returned: 0 in 0.264s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:13 devstack quobyte-client[83978]: System call of process 97950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "qemu-img rebase -u -b volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.175s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.082s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.096s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.info" returned: 0 in 0.113s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.info" returned: 0 in 0.369s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-78bb3e7d-5c1b-49a0-bf6c-f9abce5a0e89 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Create snapshot completed successfully
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "cinder-165a865a-f223-4191-90a4-8f29ae0bf275-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-165a865a-f223-4191-90a4-8f29ae0bf275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "cinder-quobyte-165a865a-f223-4191-90a4-8f29ae0bf275" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-165a865a-f223-4191-90a4-8f29ae0bf275" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Deleting offline snapshot 165a865a-f223-4191-90a4-8f29ae0bf275 of volume 9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] snapshot_file for this snap is: volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[740eb81b-8b98-4196-b1eb-c1ac38412d4f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:01:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.572s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:01:17 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38a0ae-f175-4b98-a0fd-f0368fc863ad]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:01:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" returned: 0 in 0.625s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:18 devstack quobyte-client[83978]: System call of process 98019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:18 devstack quobyte-client[83978]: System call of process 98019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.303s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd.165a865a-f223-4191-90a4-8f29ae0bf275" returned: 0 in 0.124s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-165a865a-f223-4191-90a4-8f29ae0bf275" released by "_delete_snapshot" :: held 2.057s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:18 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" released by "delete_snapshot" :: held 2.085s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:19 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Created reservations ['a6be9ec5-03f4-4eb2-8716-03f0e385ed19', '2c6c29e6-238d-4d18-af8e-8df9d8abbb26', 'a074df06-c2fc-48f6-bc7a-872968592b7e', 'b96df5dd-b3e3-4587-92aa-4f6dd2ea09cf'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:01:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Delete snapshot completed successfully.
Sep 25 20:01:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-3371da75-a65e-4fab-80b5-853388912072 tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-165a865a-f223-4191-90a4-8f29ae0bf275-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "cinder-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:20 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" acquired by "delete_volume" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acca861-d983-4142-9e1d-106296774d40]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:20 devstack quobyte-client[83978]: System call of process 98032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" returned: 0 in 0.460s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" returned: 0 in 0.149s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-quobyte-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd" released by "delete_volume" :: held 0.812s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Created reservations ['a0988a71-1a1a-4b44-a83e-03f07108dd95', '6cfc0ca6-e46c-4255-9089-7ac71d463a6b', 'd7ddb488-3df8-4870-a8fd-5e70fedf8609', '2665836a-8ab8-408f-8d70-09ae8517a6f1'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.086s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:01:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Deleted volume successfully.
Sep 25 20:01:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-fc445585-2d20-4423-96b1-ec305639e3ae tempest-VolumesSnapshotNegativeTestJSON-812390982 None] Lock "cinder-9d7fd95f-0571-45f3-adc0-bcb30f0f6ebd-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" by "attach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" acquired by "attach_volume" :: waited 0.029s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:23 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=107,cinder:SELECT=51,cinder:INSERT=22,cinder:DELETE=8 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:01:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Attaching volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0 to instance ee17b06d-eef5-471e-a50c-6d35bae8722d at mountpoint /dev/vdb on host None.
Sep 25 20:01:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Attach volume completed successfully.
Sep 25 20:01:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0ead7f9d-2d65-451d-ac23-17f57bd76182 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" released by "attach_volume" :: held 0.307s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" by "detach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:01:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:01:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Detaching volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0 from instance ee17b06d-eef5-471e-a50c-6d35bae8722d.
Sep 25 20:01:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:01:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Detach volume completed successfully.
Sep 25 20:01:24 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-204da1cf-e11a-437f-afef-4e6199006843 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:01:34 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=26,cinder:SELECT=27,cinder:INSERT=4,cinder:DELETE=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:01:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:01:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:01:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.223s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:01:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:02:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" by "attach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:02:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" acquired by "attach_volume" :: waited 0.077s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:02:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:02:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Attaching volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0 to instance e8d1e789-787d-4eca-8269-63a144620d7f at mountpoint /dev/vdb on host None.
Sep 25 20:02:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Attach volume completed successfully.
Sep 25 20:02:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6568ab0f-cba0-4513-a86b-645a2031cda0 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0" released by "attach_volume" :: held 0.400s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:02:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" by "detach_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:02:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:02:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:02:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Detaching volume 0d9594e2-a169-4f39-9e8f-7ed367f513d0 from instance e8d1e789-787d-4eca-8269-63a144620d7f.
Sep 25 20:02:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:02:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Detach volume completed successfully.
Sep 25 20:02:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f4ec9867-248e-4aba-9c93-e4cdbe5450b0 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:02:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:02:12 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:02:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:02:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:02:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:02:15 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fadf7cb-5e57-47dc-b451-5342719bf979]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:02:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:02:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.689s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:02:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2649f9-0414-4810-8f84-7645c3a5710a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:02:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:02:16 devstack quobyte-client[83978]: System call of process 98367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:02:16 devstack quobyte-client[83978]: System call of process 98367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:02:16 devstack quobyte-client[83978]: System call of process 98367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:02:16 devstack quobyte-client[83978]: System call of process 98367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:02:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.438s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:02:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.a517fb7f-df88-406e-b1b1-74816e1496f6dpollnkc.img {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:02:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.a517fb7f-df88-406e-b1b1-74816e1496f6dpollnkc.img" returned: 0 in 6.414s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:02:23 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3912ae-e5e8-4627-ba0e-ccd4609f6610]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:02:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:02:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.721s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:02:24 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.a517fb7f-df88-406e-b1b1-74816e1496f6dpollnkc.img {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:02:24 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Converted 1024.00 MB image at 159.14 MB/s
Sep 25 20:02:24 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] a517fb7f-df88-406e-b1b1-74816e1496f6 was raw, no need to convert to raw {{(pid=83952) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 25 20:02:25 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:02:34 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.202s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:02:54 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 49.532s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Uploaded volume to glance image-id: a517fb7f-df88-406e-b1b1-74816e1496f6. {{(pid=83952) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 25 20:03:05 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-97c29baf-87bf-4b05-8dab-8c16989db680 tempest-VolumesActionsTest-1756648170 None] Copy volume to image completed successfully.
Sep 25 20:03:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1d6f49-b370-4a7c-ac65-5ccb9b1cc6a8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.436s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:07 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233dfa1-2740-4f70-a2f4-b363541b586a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.539s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:07 devstack quobyte-client[83978]: System call of process 98478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img" returned: 0 in 6.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:13 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7bf4b6-4a7b-4d92-af39-0c816af482ad]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.752s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:14 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:03:14 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Converted 1024.00 MB image at 167.36 MB/s
Sep 25 20:03:14 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] 8d3f64ff-a049-4fe3-9ff5-77b5c8027149 was raw, converting to qcow2 {{(pid=83952) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 25 20:03:14 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc47e6-8875-425b-8227-77fa5e603f77]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img" returned: 0 in 0.588s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img" returned: 1 in 0.391s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img /opt/stack/data/cinder/conversion/vol_upload_gvswk1wk {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img /opt/stack/data/cinder/conversion/vol_upload_gvswk1wk" returned: 0 in 0.148s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Image conversion details: src /opt/stack/data/cinder/conversion/0d9594e2-a169-4f39-9e8f-7ed367f513d0.temp_image.8d3f64ff-a049-4fe3-9ff5-77b5c80271490wpbaacw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gvswk1wk {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:03:16 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3bc40-3f0c-45b3-8d38-9476ff1c35e8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gvswk1wk {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gvswk1wk" returned: 0 in 0.386s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:16 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:03:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.298s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Uploaded volume to glance image-id: 8d3f64ff-a049-4fe3-9ff5-77b5c8027149. {{(pid=83952) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 25 20:03:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4bab11fb-ae77-40a9-9a21-c467f74146a2 tempest-VolumesActionsTest-1756648170 None] Copy volume to image completed successfully.
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "cinder-quobyte-0d9594e2-a169-4f39-9e8f-7ed367f513d0" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-quobyte-0d9594e2-a169-4f39-9e8f-7ed367f513d0" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6be674-50d3-4c75-89b5-36cc9d6778f7]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:20 devstack quobyte-client[83978]: System call of process 98519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:20 devstack quobyte-client[83978]: System call of process 98519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:20 devstack quobyte-client[83978]: System call of process 98519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.426s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-0d9594e2-a169-4f39-9e8f-7ed367f513d0" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-quobyte-0d9594e2-a169-4f39-9e8f-7ed367f513d0" released by "delete_volume" :: held 0.685s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Created reservations ['b83f1166-b048-4749-9433-d136529a3580', '5136f924-9161-48fc-a2ac-cad930aad9f1', '9e1907fc-cf18-4945-939e-cce303cebc77', 'b67c3e90-8143-4ee2-889f-dbcd342f5d7a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:20 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Deleted volume successfully.
Sep 25 20:03:21 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ac905a37-358a-4ab3-a613-65c1a18137d4 tempest-VolumesActionsTest-1756648170 None] Lock "cinder-0d9594e2-a169-4f39-9e8f-7ed367f513d0-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Flow 'volume_create_manager' (ec5ea8b7-97cd-4870-b1e7-2c1c8b577f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2acccff-df30-46a6-8c22-e89e8c9a85dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2acccff-df30-46a6-8c22-e89e8c9a85dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-130180530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570dc59-fa3d-44b0-adc1-b3977f49a9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52d52c6d63c472eb08d26957df932e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:31Z,use_quota=True,user_id='a5202469d2254f07b1aad24be179d3d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4efdb8d-05bf-4c3f-a1af-5a90c32d75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4efdb8d-05bf-4c3f-a1af-5a90c32d75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb37bd-99ea-448f-b641-2c816502bc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb37bd-99ea-448f-b641-2c816502bc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b570dc59-fa3d-44b0-adc1-b3977f49a9fd', 'volume_name': 'volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce42e87c-75c7-4f58-8757-a1978c9e792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce42e87c-75c7-4f58-8757-a1978c9e792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9527bc2-bd68-43ef-aa2c-7a6ad67cb6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume b570dc59-fa3d-44b0-adc1-b3977f49a9fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd', 'volume_size': 1}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-130180530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570dc59-fa3d-44b0-adc1-b3977f49a9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52d52c6d63c472eb08d26957df932e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:31Z,use_quota=True,user_id='a5202469d2254f07b1aad24be179d3d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Creating volume b570dc59-fa3d-44b0-adc1-b3977f49a9fd {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:03:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:31 devstack quobyte-client[83978]: System call of process 98530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:31 devstack quobyte-client[83978]: System call of process 98530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:31 devstack quobyte-client[83978]: System call of process 98530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:31 devstack quobyte-client[83978]: System call of process 98530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:31 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=117, name=volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd 1073741824" returned: 0 in 0.691s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" returned: 0 in 0.190s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:03:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9527bc2-bd68-43ef-aa2c-7a6ad67cb6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536d2a09-ee9f-40d3-aaae-8cb124e7f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd (b570dc59-fa3d-44b0-adc1-b3977f49a9fd): created successfully
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536d2a09-ee9f-40d3-aaae-8cb124e7f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Flow 'volume_create_manager' (ec5ea8b7-97cd-4870-b1e7-2c1c8b577f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-861fdbff-0864-43cb-9239-7d54bcfce23c tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Created volume successfully.
Sep 25 20:03:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (6d86abb8-aea4-4028-97cd-b22ee9189068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f233c62-1724-4398-be70-6b39a1f00dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f233c62-1724-4398-be70-6b39a1f00dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1733016397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f5456-6424-4828-aa43-cb6bc4b134fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:33Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab8e299-7719-438e-8ec7-670a3eb0cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab8e299-7719-438e-8ec7-670a3eb0cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab2360-201c-468e-b385-42b22ee59e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bab2360-201c-468e-b385-42b22ee59e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012f5456-6424-4828-aa43-cb6bc4b134fa', 'volume_name': 'volume-012f5456-6424-4828-aa43-cb6bc4b134fa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8904747b-8fb4-4518-a1e4-30112c33d748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8904747b-8fb4-4518-a1e4-30112c33d748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96bad1b-2bd1-4e88-b365-cf934bf7b818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Volume 012f5456-6424-4828-aa43-cb6bc4b134fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012f5456-6424-4828-aa43-cb6bc4b134fa', 'volume_size': 1}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1733016397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f5456-6424-4828-aa43-cb6bc4b134fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:33Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Creating volume 012f5456-6424-4828-aa43-cb6bc4b134fa {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:03:32 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:03:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:32 devstack quobyte-client[83978]: System call of process 98534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:32 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=118, name=volume-012f5456-6424-4828-aa43-cb6bc4b134fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa 1073741824" returned: 0 in 0.306s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa" returned: 0 in 0.080s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] <== create_volume: return (448ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.458s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96bad1b-2bd1-4e88-b365-cf934bf7b818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012f5456-6424-4828-aa43-cb6bc4b134fa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3326a489-41d9-41b7-b65a-a17651d7c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Volume volume-012f5456-6424-4828-aa43-cb6bc4b134fa (012f5456-6424-4828-aa43-cb6bc4b134fa): created successfully
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3326a489-41d9-41b7-b65a-a17651d7c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (6d86abb8-aea4-4028-97cd-b22ee9189068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f7388eee-4a32-4943-a8dd-318ac70f426b tempest-VolumesListTestJSON-2131883662 None] Created volume successfully.
Sep 25 20:03:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (3220b3b2-2350-4dc7-9b6a-ffc624c8fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab6bea8-ad0d-4255-859f-90ab6cb4ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab6bea8-ad0d-4255-859f-90ab6cb4ada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1001220922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f35824-8564-4082-807f-6f787d13870b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:35Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7539128-ae72-47b0-bc52-e481e3f6e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7539128-ae72-47b0-bc52-e481e3f6e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bcbd8e-b0bb-4475-8966-ef11c492ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bcbd8e-b0bb-4475-8966-ef11c492ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f35824-8564-4082-807f-6f787d13870b', 'volume_name': 'volume-a4f35824-8564-4082-807f-6f787d13870b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54cda26-443b-4130-93e3-cbd5d3080b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54cda26-443b-4130-93e3-cbd5d3080b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d831b4e-0e27-429f-b10c-0f94be3c2604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Volume a4f35824-8564-4082-807f-6f787d13870b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f35824-8564-4082-807f-6f787d13870b', 'volume_size': 1}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1001220922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f35824-8564-4082-807f-6f787d13870b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:35Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Creating volume a4f35824-8564-4082-807f-6f787d13870b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:03:35 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=119, name=volume-a4f35824-8564-4082-807f-6f787d13870b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b 1073741824" returned: 0 in 0.330s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b" returned: 0 in 0.112s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] <== create_volume: return (519ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:03:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.533s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d831b4e-0e27-429f-b10c-0f94be3c2604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f35824-8564-4082-807f-6f787d13870b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c4f39-52b8-4cce-8ec0-16b1948980eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:36 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Volume volume-a4f35824-8564-4082-807f-6f787d13870b (a4f35824-8564-4082-807f-6f787d13870b): created successfully
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c4f39-52b8-4cce-8ec0-16b1948980eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (3220b3b2-2350-4dc7-9b6a-ffc624c8fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c13c9657-f622-4871-bba2-fc465b4f1c5e tempest-VolumesListTestJSON-2131883662 None] Created volume successfully.
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6127d52d-b28c-4b1f-9f4e-33438201b376]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" returned: 0 in 0.424s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.473s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8bef8c8-0b42-4eff-9658-445ab9bac9ce', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:03:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-582fa839-b437-4081-b344-2367a56ce738 req-6a852e23-6122-4104-b74b-ed86e9add55b tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] attachment_update completed successfully.
Sep 25 20:03:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (0cee99ac-5544-4225-ba5e-9531fafc1d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01beec23-0a01-4589-8bf4-f62762b2403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01beec23-0a01-4589-8bf4-f62762b2403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151075657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e20dd09-3f37-44b3-afb7-397faf3e56d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:38Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c6c533-6700-4afb-9ac6-af15388be9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c6c533-6700-4afb-9ac6-af15388be9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3d8ca4-e82a-416d-adcf-1436c92e7155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3d8ca4-e82a-416d-adcf-1436c92e7155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e20dd09-3f37-44b3-afb7-397faf3e56d7', 'volume_name': 'volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9950d-0b92-473f-a717-f28b0de47dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9950d-0b92-473f-a717-f28b0de47dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91544ef-a215-4919-883b-a72f4b385f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Volume 4e20dd09-3f37-44b3-afb7-397faf3e56d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7', 'volume_size': 1}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151075657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e20dd09-3f37-44b3-afb7-397faf3e56d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11cf81a9544449ecb4d9c9fa0d04b3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:38Z,use_quota=True,user_id='9652d424aa8a48b4866557a7e1847519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Creating volume 4e20dd09-3f37-44b3-afb7-397faf3e56d7 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:03:37 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:03:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:38 devstack quobyte-client[83978]: System call of process 98554 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=120, name=volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 1073741824" returned: 0 in 0.413s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7" returned: 0 in 0.100s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] <== create_volume: return (631ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.641s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91544ef-a215-4919-883b-a72f4b385f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573e533a-d717-420e-8a48-ba969b43ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Volume volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 (4e20dd09-3f37-44b3-afb7-397faf3e56d7): created successfully
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573e533a-d717-420e-8a48-ba969b43ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Flow 'volume_create_manager' (0cee99ac-5544-4225-ba5e-9531fafc1d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a1454b7f-13ec-4d6e-9da5-e81bd426d4cc tempest-VolumesListTestJSON-2131883662 None] Created volume successfully.
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-4e20dd09-3f37-44b3-afb7-397faf3e56d7-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-4e20dd09-3f37-44b3-afb7-397faf3e56d7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:43 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-quobyte-4e20dd09-3f37-44b3-afb7-397faf3e56d7" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-4e20dd09-3f37-44b3-afb7-397faf3e56d7" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dccf16b-0eec-4567-b59c-8c49275311e0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7" returned: 0 in 0.449s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-4e20dd09-3f37-44b3-afb7-397faf3e56d7" returned: 0 in 0.103s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-4e20dd09-3f37-44b3-afb7-397faf3e56d7" released by "delete_volume" :: held 0.754s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:44 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Created reservations ['8400087b-def6-404b-9446-ebe1c7e81046', '7f59280b-88ca-49c3-9bb7-51ebad38adc9', 'e55d9082-ddc0-48a7-b54e-bd4fce7996b1', '11683d74-32a6-4895-9d7c-8f81d8dc063f'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.098s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Deleted volume successfully.
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-42834991-e5a7-4733-a790-7bf37b996f00 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-4e20dd09-3f37-44b3-afb7-397faf3e56d7-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-a4f35824-8564-4082-807f-6f787d13870b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-a4f35824-8564-4082-807f-6f787d13870b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-quobyte-a4f35824-8564-4082-807f-6f787d13870b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-a4f35824-8564-4082-807f-6f787d13870b" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6828b088-5d36-467d-968d-b166c8fdac5e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:46 devstack quobyte-client[83978]: System call of process 98951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b" returned: 0 in 0.451s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a4f35824-8564-4082-807f-6f787d13870b" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-a4f35824-8564-4082-807f-6f787d13870b" released by "delete_volume" :: held 0.761s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Created reservations ['78a4be1b-eaa3-4af6-849c-7eecf3b26683', 'e91b3818-10d0-4952-b5fb-53c301edce59', '0192476d-245b-4ef9-b992-135b1840edf7', 'b5002276-d237-40c0-ac94-808fed3ef358'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.110s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Deleted volume successfully.
Sep 25 20:03:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-19099c05-3496-4d5d-a113-6724844ff987 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-a4f35824-8564-4082-807f-6f787d13870b-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-012f5456-6424-4828-aa43-cb6bc4b134fa-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-012f5456-6424-4828-aa43-cb6bc4b134fa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:48 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "cinder-quobyte-012f5456-6424-4828-aa43-cb6bc4b134fa" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-012f5456-6424-4828-aa43-cb6bc4b134fa" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[753252a2-e822-4008-a1b0-74e7b9d59e7d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa" returned: 0 in 0.405s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-012f5456-6424-4828-aa43-cb6bc4b134fa" returned: 0 in 0.109s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-quobyte-012f5456-6424-4828-aa43-cb6bc4b134fa" released by "delete_volume" :: held 0.677s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Created reservations ['11973841-2b56-48d5-9812-75b8b6c56c1e', '9a2411f6-dfaf-4782-9a58-ffcb02e8bb2f', 'eae6fd84-b9da-4f7d-b044-0a207e2b8fcc', '58411f6e-1469-4e6c-add8-1eae2d283e65'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:49 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Deleted volume successfully.
Sep 25 20:03:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e2e2703a-fee0-4b02-9afa-184fc088eea6 tempest-VolumesListTestJSON-2131883662 None] Lock "cinder-012f5456-6424-4828-aa43-cb6bc4b134fa-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:03:54 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Flow 'volume_create_manager' (3812a276-c34a-4547-93c2-6f10c16c4f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b185a111-5fdd-457c-a0af-7f8212ac5a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b185a111-5fdd-457c-a0af-7f8212ac5a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1366748914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51896174-65fc-4b97-818f-e0d7c761b800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aec2c982871468a8075fd0c18497092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:54Z,use_quota=True,user_id='419cb1377ccc46f185a9589e60c9f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be7af2b-f0f2-40eb-a2bd-822532a3a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be7af2b-f0f2-40eb-a2bd-822532a3a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4abeb1c-c2ea-41dd-b2ac-dacdbee070ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4abeb1c-c2ea-41dd-b2ac-dacdbee070ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51896174-65fc-4b97-818f-e0d7c761b800', 'volume_name': 'volume-51896174-65fc-4b97-818f-e0d7c761b800', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865767f1-123a-4e21-954b-b9f0c0320c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865767f1-123a-4e21-954b-b9f0c0320c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915e1cb7-6401-4ea6-8519-02f49c5130c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:54 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume 51896174-65fc-4b97-818f-e0d7c761b800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51896174-65fc-4b97-818f-e0d7c761b800', 'volume_size': 1}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1366748914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51896174-65fc-4b97-818f-e0d7c761b800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aec2c982871468a8075fd0c18497092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:03:54Z,use_quota=True,user_id='419cb1377ccc46f185a9589e60c9f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Creating volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:03:54 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:54 devstack quobyte-client[83978]: System call of process 99013 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:54 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=121, name=volume-51896174-65fc-4b97-818f-e0d7c761b800, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 1073741824" returned: 0 in 0.499s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800" returned: 0 in 0.154s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.466s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915e1cb7-6401-4ea6-8519-02f49c5130c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51896174-65fc-4b97-818f-e0d7c761b800', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19918f35-c64d-4f82-824a-6bc97b51a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:03:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume volume-51896174-65fc-4b97-818f-e0d7c761b800 (51896174-65fc-4b97-818f-e0d7c761b800): created successfully
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19918f35-c64d-4f82-824a-6bc97b51a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:03:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Flow 'volume_create_manager' (3812a276-c34a-4547-93c2-6f10c16c4f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:03:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bd606c17-078a-485b-900a-0b66f63f7b3d tempest-VolumesSnapshotListTestJSON-1591004903 None] Created volume successfully.
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=7 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:03:56 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Creating offline snapshot a93fe94d-759c-4238-a723-1a95d02f1c29 of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf4dfb-ba6e-44c5-b5f3-2096ae9138ab]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800" returned: 0 in 0.409s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=122, name=volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 1G" returned: 0 in 0.249s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack quobyte-client[83978]: System call of process 99029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:57 devstack quobyte-client[83978]: System call of process 99029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:57 devstack quobyte-client[83978]: System call of process 99029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.150s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.094s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.109s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.info" returned: 0 in 0.093s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:03:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.info" returned: 0 in 0.085s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.528s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:03:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-90f68001-af30-4ebc-8994-f63c20f79b91 tempest-VolumesSnapshotListTestJSON-1591004903 None] Create snapshot completed successfully
Sep 25 20:03:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Creating offline snapshot 2096da51-a48b-47f4-bb00-bd537e3bfe34 of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e1c72-4776-40fc-88f9-c3c253d4cf8f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:03:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.383s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:59 devstack quobyte-client[83978]: System call of process 99063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:59 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=124, name=volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 1G" returned: 0 in 0.267s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:59 devstack quobyte-client[83978]: System call of process 99066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.155s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.082s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:03:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.104s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.267s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9c7b58fa-6e13-4c96-a822-6aab0e0f0ef7 tempest-VolumesSnapshotListTestJSON-1591004903 None] Create snapshot completed successfully
Sep 25 20:04:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Creating offline snapshot 529811b5-ffd4-4c49-a94a-b680d9baab6c of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590a3e2-d79b-4160-aaea-dd9baa487719]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.371s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:01 devstack quobyte-client[83978]: System call of process 99075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:01 devstack quobyte-client[83978]: System call of process 99075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:01 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=125, name=volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c 1G" returned: 0 in 0.352s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:02 devstack quobyte-client[83978]: System call of process 99078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img rebase -u -b volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.133s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.080s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.311s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:02 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6eb4c129-7c5e-4572-a588-48f2bb08bcfc tempest-VolumesSnapshotListTestJSON-1591004903 None] Create snapshot completed successfully
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-529811b5-ffd4-4c49-a94a-b680d9baab6c-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-529811b5-ffd4-4c49-a94a-b680d9baab6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:04 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-529811b5-ffd4-4c49-a94a-b680d9baab6c" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-529811b5-ffd4-4c49-a94a-b680d9baab6c" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Deleting offline snapshot 529811b5-ffd4-4c49-a94a-b680d9baab6c of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] snapshot_file for this snap is: volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa69a407-1af7-46b8-afdc-81c034fb1a39]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.388s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5311b81b-d2b5-4e91-a334-c581ee8db8e1]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:04 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:05 devstack quobyte-client[83978]: System call of process 99086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.422s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.303s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.529811b5-ffd4-4c49-a94a-b680d9baab6c" returned: 0 in 0.090s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-529811b5-ffd4-4c49-a94a-b680d9baab6c" released by "_delete_snapshot" :: held 1.502s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:05 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" released by "delete_snapshot" :: held 1.567s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Created reservations ['2fe1f7a9-1c5d-459a-8617-c6c4cad090e0', '259f4ff7-abf9-4c5c-8be1-99dd20432958', '97f8a852-b2ad-4cce-bad1-fc36173da943', 'fd420826-7c1b-4f13-83cb-175fd13cdc91'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:04:06 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Delete snapshot completed successfully.
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b9bd24ec-6def-4027-8a93-8bcf6d40d9df tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-529811b5-ffd4-4c49-a94a-b680d9baab6c-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-2096da51-a48b-47f4-bb00-bd537e3bfe34-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-2096da51-a48b-47f4-bb00-bd537e3bfe34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-2096da51-a48b-47f4-bb00-bd537e3bfe34" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-2096da51-a48b-47f4-bb00-bd537e3bfe34" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Deleting offline snapshot 2096da51-a48b-47f4-bb00-bd537e3bfe34 of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] snapshot_file for this snap is: volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[65325f59-dde1-4eda-a524-49911adf318f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.381s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6998e0cc-2809-49e1-aeb3-7e81d3541d29]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.447s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.283s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.2096da51-a48b-47f4-bb00-bd537e3bfe34" returned: 0 in 0.189s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-83d6dee9-3e7a-40ca-b4b2-f416c2968ca3 req-2f6cbbdb-10e6-4f82-a869-ed3d66a4ae6f tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-2096da51-a48b-47f4-bb00-bd537e3bfe34" released by "_delete_snapshot" :: held 1.875s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" released by "delete_snapshot" :: held 1.912s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:08 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-83d6dee9-3e7a-40ca-b4b2-f416c2968ca3 req-2f6cbbdb-10e6-4f82-a869-ed3d66a4ae6f tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-83d6dee9-3e7a-40ca-b4b2-f416c2968ca3 req-2f6cbbdb-10e6-4f82-a869-ed3d66a4ae6f tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Terminate volume connection completed successfully.
Sep 25 20:04:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-83d6dee9-3e7a-40ca-b4b2-f416c2968ca3 req-2f6cbbdb-10e6-4f82-a869-ed3d66a4ae6f tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Deleting attachment d8bef8c8-0b42-4eff-9658-445ab9bac9ce. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:04:08 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Created reservations ['28fe41ac-ccf6-42af-93db-fc507785dc96', '99c529b9-4b51-4319-938a-06b13d784d44', '66575040-23ac-47d7-ac4b-2cfae8eb7a4c', 'd404daae-abb1-4591-9d45-7c7918dc442c'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:04:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Delete snapshot completed successfully.
Sep 25 20:04:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8ae2acf5-63da-401f-a21b-24fd2a9fef3c tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-2096da51-a48b-47f4-bb00-bd537e3bfe34-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "cinder-b570dc59-fa3d-44b0-adc1-b3977f49a9fd-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-a93fe94d-759c-4238-a723-1a95d02f1c29-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-a93fe94d-759c-4238-a723-1a95d02f1c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "cinder-b570dc59-fa3d-44b0-adc1-b3977f49a9fd-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-a93fe94d-759c-4238-a723-1a95d02f1c29" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-a93fe94d-759c-4238-a723-1a95d02f1c29" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Deleting offline snapshot a93fe94d-759c-4238-a723-1a95d02f1c29 of volume 51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] snapshot_file for this snap is: volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580950a-d886-41ab-b125-381d5a631f2b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:09 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "cinder-quobyte-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "cinder-quobyte-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" acquired by "delete_volume" :: waited 0.085s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ca6c1-5d3e-4e0b-9e02-29dc0ec5bafb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.555s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51896174-65fc-4b97-818f-e0d7c761b800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c9afd-ee0c-4155-b5e0-2a19423ff8ce]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" returned: 0 in 0.578s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack quobyte-client[83978]: System call of process 99110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" returned: 0 in 0.153s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800" returned: 0 in 0.600s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "cinder-quobyte-b570dc59-fa3d-44b0-adc1-b3977f49a9fd" released by "delete_volume" :: held 1.056s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.350s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800.a93fe94d-759c-4238-a723-1a95d02f1c29" returned: 0 in 0.257s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-a93fe94d-759c-4238-a723-1a95d02f1c29" released by "_delete_snapshot" :: held 2.011s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Created reservations ['16a79332-a996-4579-a4ef-aa27a749503b', 'f72cbc3d-b546-44dc-af07-93d9af0b16d7', '571805fc-9ee7-42b0-a856-cd447ba1f2cb', '67368f10-c688-4cb7-819b-bf0ed950c482'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" released by "delete_snapshot" :: held 2.128s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.246s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:12 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:04:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Deleted volume successfully.
Sep 25 20:04:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e3fc2b8d-b037-4e60-bdfd-114358013ece tempest-TestServerVolumeAttachScenarioOldVersion-1336398154 None] Lock "cinder-b570dc59-fa3d-44b0-adc1-b3977f49a9fd-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:12 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Created reservations ['bca514e1-8d4c-4fcb-8903-0d128a25e709', '51d4d9e1-cfa2-4660-87fb-113d73cc386d', '602a43c0-638d-45dc-abd9-9515d4e96d88', '7842f2a0-7c0b-4d0e-8b1d-312c187a7e1d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:04:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Delete snapshot completed successfully.
Sep 25 20:04:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c41e13d-a5b4-4029-9cdf-7f263edd2cfb tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-a93fe94d-759c-4238-a723-1a95d02f1c29-delete_snapshot" released by "delete_snapshot" :: held 2.898s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-51896174-65fc-4b97-818f-e0d7c761b800-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-51896174-65fc-4b97-818f-e0d7c761b800-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e20d0-70d9-4b5c-bbe1-528d4eec7df6]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800" returned: 0 in 0.488s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-51896174-65fc-4b97-818f-e0d7c761b800" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-quobyte-51896174-65fc-4b97-818f-e0d7c761b800" released by "delete_volume" :: held 0.757s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Created reservations ['40a3f158-6665-4fb0-86c2-18effe37338d', '37622c20-55c1-443e-a636-16cdf98c67fb', '36c2d0a4-36f4-4246-a2f7-d86bdd11f94e', '9d1cad09-d30b-4f1c-bf34-f448241676be'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.322s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:15 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:04:15 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Deleted volume successfully.
Sep 25 20:04:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-318318be-b099-4886-85b2-b0b597deb462 tempest-VolumesSnapshotListTestJSON-1591004903 None] Lock "cinder-51896174-65fc-4b97-818f-e0d7c761b800-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:04:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=58,cinder:UPDATE=89,cinder:INSERT=15,cinder:DELETE=4 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:04:25 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=35,cinder:DELETE=3,cinder:SELECT=28,cinder:INSERT=13 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:04:42 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (03771752-1eb1-4b6b-b2cd-fe8d2ff7315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a15ec-0bc8-400a-a602-bd67600669ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a15ec-0bc8-400a-a602-bd67600669ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-906981426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c40d30-3ec8-4dfe-b26f-4629bdee549c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:42Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b94d7b-2337-4120-afd4-7d6375b32cfc),volume_type_id=89b94d7b-2337-4120-afd4-7d6375b32cfc)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521a9a74-16d6-4036-bb93-dd2dabd717d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521a9a74-16d6-4036-bb93-dd2dabd717d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a23ea2-e8a4-409c-b2a1-62f366c6d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a23ea2-e8a4-409c-b2a1-62f366c6d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c40d30-3ec8-4dfe-b26f-4629bdee549c', 'volume_name': 'volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef99a68-d8be-4df5-b253-54c11002d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef99a68-d8be-4df5-b253-54c11002d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b5010-33d2-486f-87ff-9d9b0727f197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:42 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Volume 45c40d30-3ec8-4dfe-b26f-4629bdee549c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c', 'volume_size': 1}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-906981426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c40d30-3ec8-4dfe-b26f-4629bdee549c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:42Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b94d7b-2337-4120-afd4-7d6375b32cfc),volume_type_id=89b94d7b-2337-4120-afd4-7d6375b32cfc)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Creating volume 45c40d30-3ec8-4dfe-b26f-4629bdee549c {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:04:42 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:04:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:42 devstack quobyte-client[83978]: System call of process 99174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:42 devstack quobyte-client[83978]: System call of process 99174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:42 devstack quobyte-client[83978]: System call of process 99174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:42 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=126, name=volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:04:43 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (80543178-578f-49f1-ae19-499f3dddddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70fcf4d-88b5-42b9-9e72-147051dd46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70fcf4d-88b5-42b9-9e72-147051dd46a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1945701756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd5c216-24c9-4dc6-90ce-b3c56e84772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:42Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d25bdb80-d16d-4f2e-8d2b-3a3f9661fa33),volume_type_id=d25bdb80-d16d-4f2e-8d2b-3a3f9661fa33)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee56726e-49a6-4b8d-a9f2-5032b865ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee56726e-49a6-4b8d-a9f2-5032b865ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6720c19f-cd8c-4caf-a86b-6cbb55d9b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6720c19f-cd8c-4caf-a86b-6cbb55d9b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd5c216-24c9-4dc6-90ce-b3c56e84772b', 'volume_name': 'volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e4524e-d9b2-4915-a7cc-cbfcc22ab68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e4524e-d9b2-4915-a7cc-cbfcc22ab68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe5a5cc-466a-4d1f-a7ef-f80a89c0b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:43 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Volume cbd5c216-24c9-4dc6-90ce-b3c56e84772b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b', 'volume_size': 1}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c 1073741824" returned: 0 in 0.791s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c" returned: 0 in 0.522s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] <== create_volume: return (1375ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1945701756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd5c216-24c9-4dc6-90ce-b3c56e84772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:42Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d25bdb80-d16d-4f2e-8d2b-3a3f9661fa33),volume_type_id=d25bdb80-d16d-4f2e-8d2b-3a3f9661fa33)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Creating volume cbd5c216-24c9-4dc6-90ce-b3c56e84772b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:04:44 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:44 devstack quobyte-client[83978]: System call of process 99178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:44 devstack quobyte-client[83978]: System call of process 99178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:44 devstack quobyte-client[83978]: System call of process 99178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:44 devstack quobyte-client[83978]: System call of process 99178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:44 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=127, name=volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:04:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (fdf5068e-1cb3-4642-b94c-51aee17758ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18abe7a-9d64-4c52-874c-71fbc3890e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b5010-33d2-486f-87ff-9d9b0727f197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f6be17-a540-4761-97f5-8892c2e0d4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18abe7a-9d64-4c52-874c-71fbc3890e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-766221277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825fa1c7-a406-4cba-add0-759600230db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:43Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(049bb75c-170e-4471-a14c-c49a1d3a6997),volume_type_id=049bb75c-170e-4471-a14c-c49a1d3a6997)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2d7709-a08f-4a06-9831-3dae6d3c0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2d7709-a08f-4a06-9831-3dae6d3c0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b613c7cc-550b-41b0-9643-a954a6ca143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:44 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 20:04:45 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Volume volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c (45c40d30-3ec8-4dfe-b26f-4629bdee549c): created successfully
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f6be17-a540-4761-97f5-8892c2e0d4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (03771752-1eb1-4b6b-b2cd-fe8d2ff7315e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b 1073741824" returned: 0 in 0.982s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-fbb45bda-55c3-483b-8382-af19729998ff tempest-TestInstancesWithCinderVolumes-713350558 None] Created volume successfully.
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" returned: 0 in 0.433s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] <== create_volume: return (1475ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe5a5cc-466a-4d1f-a7ef-f80a89c0b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f3082c-5f19-4636-b24e-9f0b80f13ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:45 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Volume volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b (cbd5c216-24c9-4dc6-90ce-b3c56e84772b): created successfully
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f3082c-5f19-4636-b24e-9f0b80f13ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (80543178-578f-49f1-ae19-499f3dddddf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b613c7cc-550b-41b0-9643-a954a6ca143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '825fa1c7-a406-4cba-add0-759600230db2', 'volume_name': 'volume-825fa1c7-a406-4cba-add0-759600230db2', 'volume_size': 1, 'image_id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--83085154', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39835feef3064c36bab7e9e0628cdea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'created_at': datetime.datetime(2025, 9, 25, 18, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97905948e0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67f2522-c531-4605-9057-29b6f04b5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67f2522-c531-4605-9057-29b6f04b5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431ae69e-3d6c-47f3-867e-aedf623c5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:45 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume 825fa1c7-a406-4cba-add0-759600230db2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-825fa1c7-a406-4cba-add0-759600230db2', 'volume_size': 1, 'image_id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--83085154', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39835feef3064c36bab7e9e0628cdea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'created_at': datetime.datetime(2025, 9, 25, 18, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97905948e0>}
Sep 25 20:04:45 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Cloning 825fa1c7-a406-4cba-add0-759600230db2 from image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9  at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 20:04:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1b025f96-3a82-4bb4-b383-28f481c9293c tempest-TestInstancesWithCinderVolumes-713350558 None] Created volume successfully.
Sep 25 20:04:47 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD, size 20.69 MB, duration 1.57 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 20:04:47 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Image download 20.69 MB at 13.16 MB/s
Sep 25 20:04:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152823a-a30b-4762-8479-90e4b8d52e96]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:48 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD
Sep 25 20:04:48 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:04:49 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Sep 25 20:04:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD" returned: 0 in 2.359s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:49 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Temporary image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 is fetched for user f6582bbd9ec04b72ba0d343b5bb73e20. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 20:04:50 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9068e0-c0ca-40c5-8045-1f272434813f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:51 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD
Sep 25 20:04:51 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:04:53 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD" returned: 0 in 3.220s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-766221277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825fa1c7-a406-4cba-add0-759600230db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39835feef3064c36bab7e9e0628cdea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:04:43Z,use_quota=True,user_id='f6582bbd9ec04b72ba0d343b5bb73e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(049bb75c-170e-4471-a14c-c49a1d3a6997),volume_type_id=049bb75c-170e-4471-a14c-c49a1d3a6997)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Creating volume 825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:04:53 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:04:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:53 devstack quobyte-client[83978]: System call of process 99236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:53 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=128, name=volume-825fa1c7-a406-4cba-add0-759600230db2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 1073741824" returned: 0 in 0.358s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Attempting download of dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}])) to volume 825fa1c7-a406-4cba-add0-759600230db2. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e1e8e-7ac7-4755-89d0-b3e908f86c87]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_nhrkfw6y {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:04:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.147s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_nhrkfw6y" returned: 0 in 0.514s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_nhrkfw6y {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_nhrkfw6y" returned: 1 in 0.379s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_nhrkfw6y' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c433ca8c-db96-458a-8bfd-332c3716d5fe]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:56 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 was qcow2, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 20:04:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:56 devstack quobyte-client[83978]: System call of process 99248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:56 devstack quobyte-client[83978]: System call of process 99248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:56 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=128, name=volume-825fa1c7-a406-4cba-add0-759600230db2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 1.039s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9_zzg7gubjdevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:04:57 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Converted 112.00 MB image at 103.60 MB/s
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:57 devstack quobyte-client[83978]: System call of process 99258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:57 devstack quobyte-client[83978]: System call of process 99258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 1G" returned: 0 in 0.192s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba639e1e-bff7-436f-a982-5ea93ef36a8b]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:04:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:57 devstack quobyte-client[83978]: System call of process 99261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 0.446s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:04:58 devstack quobyte-client[83978]: System call of process 99263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 1 in 0.578s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Downloaded image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}])) to volume 825fa1c7-a406-4cba-add0-759600230db2 successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Temporary image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 for user f6582bbd9ec04b72ba0d343b5bb73e20 is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Marking volume 825fa1c7-a406-4cba-add0-759600230db2 as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Copying metadata from image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 to 825fa1c7-a406-4cba-add0-759600230db2. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 20:04:58 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Creating volume glance metadata for volume 825fa1c7-a406-4cba-add0-759600230db2 backed by image dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9 with: {'image_id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'image_name': 'tempest-scenario-img--83085154', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 20:04:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431ae69e-3d6c-47f3-867e-aedf623c5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825fa1c7-a406-4cba-add0-759600230db2', 'volume_size': 1, 'image_id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--83085154', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39835feef3064c36bab7e9e0628cdea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9', 'created_at': datetime.datetime(2025, 9, 25, 18, 4, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 4, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2ecb7b-1e3d-40c7-b5f2-c8661cdac6c9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97905948e0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68baac6-05a9-4aba-b802-cdb810bf9010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:04:59 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume volume-825fa1c7-a406-4cba-add0-759600230db2 (825fa1c7-a406-4cba-add0-759600230db2): created successfully
Sep 25 20:04:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68baac6-05a9-4aba-b802-cdb810bf9010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:04:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Flow 'volume_create_manager' (fdf5068e-1cb3-4642-b94c-51aee17758ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:04:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c377affb-8339-4d0e-90db-f79175e263e1 tempest-TestInstancesWithCinderVolumes-713350558 None] Created volume successfully.
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2fca4-a4d3-4a68-91ef-7af350b6aa19]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 0.652s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 1 in 0.520s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:05:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.441s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:10 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-825fa1c7-a406-4cba-add0-759600230db2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2948f845-ea21-42ad-9daf-d10940dbda3f', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:05:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:05:11 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-7463ea5a-77dd-4599-8b9a-955ae51f2582 req-b7d56bbc-953e-4208-94f3-42be5eba3de4 tempest-TestInstancesWithCinderVolumes-713350558 None] attachment_update completed successfully.
Sep 25 20:05:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Flow 'volume_create_manager' (df2b0184-6270-4994-9f3b-b531d4683bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1819c881-57c6-4ce3-9087-eff52df34823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1819c881-57c6-4ce3-9087-eff52df34823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-525534387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd289ea-647b-4cc5-9835-d9d50b00e1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59aeec0f4aa043c79d6bf2d90119a464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:05:16Z,use_quota=True,user_id='baeae403d40b4b299ec9d131b8b1a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bb5ada-4a44-4472-8df3-751c471eb86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bb5ada-4a44-4472-8df3-751c471eb86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f19a99e-8da6-4571-b0ba-3d8cddc1df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f19a99e-8da6-4571-b0ba-3d8cddc1df8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd289ea-647b-4cc5-9835-d9d50b00e1c8', 'volume_name': 'volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413bc034-27ec-425b-ba96-4f6403a7fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413bc034-27ec-425b-ba96-4f6403a7fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e249232b-a6bb-46d0-8c5c-ee0a90ccbc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:16 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume ddd289ea-647b-4cc5-9835-d9d50b00e1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8', 'volume_size': 1}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-525534387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd289ea-647b-4cc5-9835-d9d50b00e1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59aeec0f4aa043c79d6bf2d90119a464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:05:16Z,use_quota=True,user_id='baeae403d40b4b299ec9d131b8b1a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Creating volume ddd289ea-647b-4cc5-9835-d9d50b00e1c8 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:05:16 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:05:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:16 devstack quobyte-client[83978]: System call of process 99353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:05:17 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=129, name=volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:05:17 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:05:17 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:05:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Flow 'volume_create_manager' (83b7a6d7-c4bf-432a-8b08-f589adcf5ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:05:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5757f6bc-8fe3-43df-8fca-7aed75adce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 1073741824" returned: 0 in 1.050s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5757f6bc-8fe3-43df-8fca-7aed75adce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-560798260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6de2576-aa42-4725-a107-003677b20c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59aeec0f4aa043c79d6bf2d90119a464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:05:17Z,use_quota=True,user_id='baeae403d40b4b299ec9d131b8b1a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6efd9a-ee60-4547-9c44-c690943a3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6efd9a-ee60-4547-9c44-c690943a3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd08e254-4467-433e-b2b0-cd97c1812017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd08e254-4467-433e-b2b0-cd97c1812017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6de2576-aa42-4725-a107-003677b20c45', 'volume_name': 'volume-f6de2576-aa42-4725-a107-003677b20c45', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e3c9f-1a9e-4c0d-86d9-13e124969346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e3c9f-1a9e-4c0d-86d9-13e124969346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bc6c99-595a-4a3a-8443-b79a4c647807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:18 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume f6de2576-aa42-4725-a107-003677b20c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6de2576-aa42-4725-a107-003677b20c45', 'volume_size': 1}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" returned: 0 in 0.451s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] <== create_volume: return (1550ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-560798260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6de2576-aa42-4725-a107-003677b20c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59aeec0f4aa043c79d6bf2d90119a464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:05:17Z,use_quota=True,user_id='baeae403d40b4b299ec9d131b8b1a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Creating volume f6de2576-aa42-4725-a107-003677b20c45 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:05:18 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e249232b-a6bb-46d0-8c5c-ee0a90ccbc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack quobyte-client[83978]: System call of process 99677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:05:18 devstack quobyte-client[83978]: System call of process 99677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e03d10-df6f-4216-9df6-fecf5671ed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:18 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=130, name=volume-f6de2576-aa42-4725-a107-003677b20c45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:05:18 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 (ddd289ea-647b-4cc5-9835-d9d50b00e1c8): created successfully
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e03d10-df6f-4216-9df6-fecf5671ed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Flow 'volume_create_manager' (df2b0184-6270-4994-9f3b-b531d4683bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:05:18 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f88b72ba-4bec-4ead-bb00-f76b4102d1d0 tempest-TestServerVolumeAttachmentScenario-151012999 None] Created volume successfully.
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 1073741824" returned: 0 in 0.798s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45" returned: 0 in 0.142s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] <== create_volume: return (997ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bc6c99-595a-4a3a-8443-b79a4c647807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6de2576-aa42-4725-a107-003677b20c45', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c117d179-c1d6-415f-9e3b-68ab1c01bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:05:19 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume volume-f6de2576-aa42-4725-a107-003677b20c45 (f6de2576-aa42-4725-a107-003677b20c45): created successfully
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c117d179-c1d6-415f-9e3b-68ab1c01bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:05:19 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Flow 'volume_create_manager' (83b7a6d7-c4bf-432a-8b08-f589adcf5ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:05:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ba7bb88b-c7f4-4100-94ea-58f5e3cc9724 tempest-TestServerVolumeAttachmentScenario-151012999 None] Created volume successfully.
Sep 25 20:05:29 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:05:29 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=12,cinder:SELECT=16,cinder:DELETE=3,cinder:INSERT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:05:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:05:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:05:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:05:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.083s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:05:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:05:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:05:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.164s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:05:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:05:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.854s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:05:56 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:06:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:06:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:06:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c3342-121c-4e74-96ec-5ac9839beb9e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:06:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:06:33 devstack quobyte-client[83978]: System call of process 99999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:06:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c" returned: 0 in 0.549s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:06:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.621s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:06:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1269db56-1679-49e8-b4e0-36041125e6d5', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:06:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:06:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-4bd8b03c-6312-4017-9165-e7a569edddf3 req-644a46a6-1ab7-445f-8679-5fb46f64c4c1 tempest-TestInstancesWithCinderVolumes-713350558 None] attachment_update completed successfully.
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=7 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a741679-8d60-4f61-94e9-1c3da621f4d9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:06:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:06:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" returned: 0 in 0.452s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:06:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.510s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:06:44 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a96d755-e368-411d-b8bf-b1c860fdec5d', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:06:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:06:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-e39073d3-17e6-42be-910b-fff69bdc8628 req-1c5d6822-b34e-4763-a17a-783feb60ceba tempest-TestInstancesWithCinderVolumes-713350558 None] attachment_update completed successfully.
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:06:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:06:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.399s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:06:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:06:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:06:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:06:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af70c09-5907-4f77-87f7-d2cf1cef09b3]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:06:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:06:57 devstack quobyte-client[83978]: System call of process 100131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:06:57 devstack quobyte-client[83978]: System call of process 100131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:06:57 devstack quobyte-client[83978]: System call of process 100131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:06:57 devstack quobyte-client[83978]: System call of process 100131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:06:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" returned: 0 in 0.878s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:06:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:06:57 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4ca2a21-bb7d-4ed2-8fac-30e7c72eacce', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:06:57 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:06:58 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-c4120914-085b-4a4f-b538-b0a82a8c97c7 req-3b5b5482-3900-4b3e-abb2-23e79239a028 tempest-TestServerVolumeAttachmentScenario-151012999 None] attachment_update completed successfully.
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbe4a6-55d1-4e95-aa80-10890f83286f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45" returned: 0 in 0.388s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.448s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:07:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2', 'name': 'volume-f6de2576-aa42-4725-a107-003677b20c45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19cb71c9-039a-4456-98e1-76ca347293dc', 'enforce_multipath': True} {{(pid=83952) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 25 20:07:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-688bb0c8-a683-4ee5-b1be-4228e8acd7d9 req-36122528-b662-4d5e-bbfd-2634e6e1af5f tempest-TestServerVolumeAttachmentScenario-151012999 None] attachment_update completed successfully.
Sep 25 20:07:19 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:19 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:20 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f0c521bf-07dd-4621-9bbc-057087849173 req-493851fd-9415-4da0-ae66-0255836f6a4e tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:20 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f0c521bf-07dd-4621-9bbc-057087849173 req-493851fd-9415-4da0-ae66-0255836f6a4e tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:20 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-f0c521bf-07dd-4621-9bbc-057087849173 req-493851fd-9415-4da0-ae66-0255836f6a4e tempest-TestInstancesWithCinderVolumes-713350558 None] Terminate volume connection completed successfully.
Sep 25 20:07:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-f0c521bf-07dd-4621-9bbc-057087849173 req-493851fd-9415-4da0-ae66-0255836f6a4e tempest-TestInstancesWithCinderVolumes-713350558 None] Deleting attachment 1269db56-1679-49e8-b4e0-36041125e6d5. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-45c40d30-3ec8-4dfe-b26f-4629bdee549c-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-45c40d30-3ec8-4dfe-b26f-4629bdee549c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:07:22 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-quobyte-45c40d30-3ec8-4dfe-b26f-4629bdee549c" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-45c40d30-3ec8-4dfe-b26f-4629bdee549c" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ecb1b-dcde-4c7d-a583-265a9868407f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c" returned: 0 in 0.535s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-45c40d30-3ec8-4dfe-b26f-4629bdee549c" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-45c40d30-3ec8-4dfe-b26f-4629bdee549c" released by "delete_volume" :: held 0.789s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:07:23 devstack cinder-volume[83952]: WARNING cinder.quota [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1930078179-1560842778 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1930078179-1560842778, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:07:23 devstack cinder-volume[83952]: WARNING cinder.quota [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1930078179-1560842778 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1930078179-1560842778, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Created reservations ['db6392f6-62d3-4bf0-a39f-d5a8d040f7df', '1146e76f-7222-495f-a95a-7e455a60b15e', '8531f370-802e-4d20-8061-cf84b798b441', '6fc2be14-15a5-4c1b-93ed-e3a776ab8c73'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.146s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:07:23 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Deleted volume successfully.
Sep 25 20:07:23 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8d971634-ef81-42d6-87b0-3f8a6814518d tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-45c40d30-3ec8-4dfe-b26f-4629bdee549c-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:07:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-5ac24d57-4da4-45bc-9a30-9c2d941d51b0 req-a1c7dbc3-37e3-4e50-a0f1-90bbacde40e6 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-5ac24d57-4da4-45bc-9a30-9c2d941d51b0 req-a1c7dbc3-37e3-4e50-a0f1-90bbacde40e6 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-5ac24d57-4da4-45bc-9a30-9c2d941d51b0 req-a1c7dbc3-37e3-4e50-a0f1-90bbacde40e6 tempest-TestServerVolumeAttachmentScenario-151012999 None] Terminate volume connection completed successfully.
Sep 25 20:07:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-5ac24d57-4da4-45bc-9a30-9c2d941d51b0 req-a1c7dbc3-37e3-4e50-a0f1-90bbacde40e6 tempest-TestServerVolumeAttachmentScenario-151012999 None] Deleting attachment 19cb71c9-039a-4456-98e1-76ca347293dc. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:07:41 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:45 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:07:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-4d0fc87f-62ce-4dbd-a7ce-b2e9802a96b6 req-5fac54f3-5e94-4165-9eab-38f67f5581d3 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-4d0fc87f-62ce-4dbd-a7ce-b2e9802a96b6 req-5fac54f3-5e94-4165-9eab-38f67f5581d3 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:50 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-4d0fc87f-62ce-4dbd-a7ce-b2e9802a96b6 req-5fac54f3-5e94-4165-9eab-38f67f5581d3 tempest-TestInstancesWithCinderVolumes-713350558 None] Terminate volume connection completed successfully.
Sep 25 20:07:50 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-4d0fc87f-62ce-4dbd-a7ce-b2e9802a96b6 req-5fac54f3-5e94-4165-9eab-38f67f5581d3 tempest-TestInstancesWithCinderVolumes-713350558 None] Deleting attachment 0a96d755-e368-411d-b8bf-b1c860fdec5d. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-cbd5c216-24c9-4dc6-90ce-b3c56e84772b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-cbd5c216-24c9-4dc6-90ce-b3c56e84772b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:07:52 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-quobyte-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1674374-30be-4a36-96ec-c6e0710b457f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:52 devstack quobyte-client[83978]: System call of process 100250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" returned: 0 in 0.535s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" returned: 0 in 0.130s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-cbd5c216-24c9-4dc6-90ce-b3c56e84772b" released by "delete_volume" :: held 0.810s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:07:53 devstack cinder-volume[83952]: WARNING cinder.quota [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1441860140-792606846 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1441860140-792606846, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:07:53 devstack cinder-volume[83952]: WARNING cinder.quota [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1441860140-792606846 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1441860140-792606846, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Created reservations ['17b7d526-68fa-41b7-b132-1af9cb40142c', 'feea3c3d-edc3-43fa-945c-2682227a8fed', 'd9d1b40a-c77d-4d11-bbf3-445fc45064b2', '4cdde598-2998-45bb-b649-7ae524cda2b6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.091s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:53 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:07:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Deleted volume successfully.
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-51b4541c-4fe2-4502-aee3-c48c3237c791 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-cbd5c216-24c9-4dc6-90ce-b3c56e84772b-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:07:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:07:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.287s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:07:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:07:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-cf3be219-c2f6-414a-b276-82adc3ba1dc1 req-87434ea4-a38e-4ee2-b08f-3f4187988e24 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:59 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-cf3be219-c2f6-414a-b276-82adc3ba1dc1 req-87434ea4-a38e-4ee2-b08f-3f4187988e24 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:07:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-cf3be219-c2f6-414a-b276-82adc3ba1dc1 req-87434ea4-a38e-4ee2-b08f-3f4187988e24 tempest-TestServerVolumeAttachmentScenario-151012999 None] Terminate volume connection completed successfully.
Sep 25 20:07:59 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-cf3be219-c2f6-414a-b276-82adc3ba1dc1 req-87434ea4-a38e-4ee2-b08f-3f4187988e24 tempest-TestServerVolumeAttachmentScenario-151012999 None] Deleting attachment a4ca2a21-bb7d-4ed2-8fac-30e7c72eacce. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:08:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f036072c-8c62-4881-aad1-747b9725834a req-3723b3e8-f678-46f6-8970-b0e74beac643 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:01 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [req-f036072c-8c62-4881-aad1-747b9725834a req-3723b3e8-f678-46f6-8970-b0e74beac643 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [req-f036072c-8c62-4881-aad1-747b9725834a req-3723b3e8-f678-46f6-8970-b0e74beac643 tempest-TestInstancesWithCinderVolumes-713350558 None] Terminate volume connection completed successfully.
Sep 25 20:08:01 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [req-f036072c-8c62-4881-aad1-747b9725834a req-3723b3e8-f678-46f6-8970-b0e74beac643 tempest-TestInstancesWithCinderVolumes-713350558 None] Deleting attachment 2948f845-ea21-42ad-9daf-d10940dbda3f. {{(pid=83952) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-825fa1c7-a406-4cba-add0-759600230db2-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-825fa1c7-a406-4cba-add0-759600230db2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "cinder-quobyte-825fa1c7-a406-4cba-add0-759600230db2" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-825fa1c7-a406-4cba-add0-759600230db2" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[db024080-8728-4749-b483-5199b8961aaf]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 0.505s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 1 in 0.429s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-825fa1c7-a406-4cba-add0-759600230db2" returned: 0 in 0.128s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-quobyte-825fa1c7-a406-4cba-add0-759600230db2" released by "delete_volume" :: held 1.375s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:07 devstack cinder-volume[83952]: WARNING cinder.quota [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5171925-1213369934 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5171925-1213369934, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:08:07 devstack cinder-volume[83952]: WARNING cinder.quota [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5171925-1213369934 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5171925-1213369934, it is now deprecated. Please use the default quota class for default quota.
Sep 25 20:08:07 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Created reservations ['87ad3678-6eaa-484a-98c5-359cdc96033a', '4f724217-a91d-436b-8a54-b04f56f890e4', '4a703691-3e90-4128-9930-70cc7d92d3d4', '09997d22-5c9c-4903-8951-f2caa4b9d6b6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.180s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:08 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Deleted volume successfully.
Sep 25 20:08:08 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ebf34075-a3f2-4e57-89d0-663f21e5cc98 tempest-TestInstancesWithCinderVolumes-713350558 None] Lock "cinder-825fa1c7-a406-4cba-add0-759600230db2-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "cinder-f6de2576-aa42-4725-a107-003677b20c45-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-f6de2576-aa42-4725-a107-003677b20c45-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:12 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "cinder-quobyte-f6de2576-aa42-4725-a107-003677b20c45" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-quobyte-f6de2576-aa42-4725-a107-003677b20c45" acquired by "delete_volume" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7874d6-0796-4248-ba02-5b44bd07901d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45" returned: 0 in 0.496s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f6de2576-aa42-4725-a107-003677b20c45" returned: 0 in 0.124s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-quobyte-f6de2576-aa42-4725-a107-003677b20c45" released by "delete_volume" :: held 0.821s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Created reservations ['efcc6148-5fc5-43de-894e-5ab420f39ef5', 'a0982c02-d17e-44c9-bd88-6fda9f2ec86b', 'c7f720ed-b05e-4772-b9d3-cc5a9f9b7eb2', 'f02d2db6-2073-4269-a215-82bd0cf7b624'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.137s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:14 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Deleted volume successfully.
Sep 25 20:08:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b2cb1907-9845-4a36-859d-e5e80acf61f9 tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-f6de2576-aa42-4725-a107-003677b20c45-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "cinder-ddd289ea-647b-4cc5-9835-d9d50b00e1c8-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-ddd289ea-647b-4cc5-9835-d9d50b00e1c8-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "cinder-quobyte-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-quobyte-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" acquired by "delete_volume" :: waited 0.010s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[14821427-df4e-405e-aafe-f14f12721b3d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:15 devstack quobyte-client[83978]: System call of process 100392 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" returned: 0 in 0.493s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" returned: 0 in 0.112s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:15 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-quobyte-ddd289ea-647b-4cc5-9835-d9d50b00e1c8" released by "delete_volume" :: held 0.819s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Created reservations ['9c9f5a0e-ae5e-4ba4-bd67-9d660f355ccf', '188325db-f760-42d9-8370-2f2665c3d8c9', '1d96ace9-8d4a-4ac2-bfcf-1209361c1899', 'ae066f1c-2192-49ea-ad2a-22dd17524f47'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.095s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:16 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Deleted volume successfully.
Sep 25 20:08:16 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dad66459-1aa5-4855-8255-f9b0fd7d455f tempest-TestServerVolumeAttachmentScenario-151012999 None] Lock "cinder-ddd289ea-647b-4cc5-9835-d9d50b00e1c8-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=22,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=24,cinder:INSERT=11,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:08:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (36e81e97-96c1-42f8-8e18-4463f5457d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad156493-44e1-4e8e-8b6e-7adaf9d43f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad156493-44e1-4e8e-8b6e-7adaf9d43f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079617515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8079c327-d9d4-4721-91d0-9987e11825fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:27Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4423367e-4a37-4220-be86-d1b4c2c9a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4423367e-4a37-4220-be86-d1b4c2c9a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0464d80-e678-4add-b50e-182aa3592639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0464d80-e678-4add-b50e-182aa3592639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8079c327-d9d4-4721-91d0-9987e11825fe', 'volume_name': 'volume-8079c327-d9d4-4721-91d0-9987e11825fe', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398deb62-83c2-40d1-ac3c-4e599266caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398deb62-83c2-40d1-ac3c-4e599266caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587ce710-a752-4b16-b7dd-604f03d2811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:26 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume 8079c327-d9d4-4721-91d0-9987e11825fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8079c327-d9d4-4721-91d0-9987e11825fe', 'volume_size': 1}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079617515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8079c327-d9d4-4721-91d0-9987e11825fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:27Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume 8079c327-d9d4-4721-91d0-9987e11825fe {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:26 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:27 devstack quobyte-client[83978]: System call of process 100405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:27 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=131, name=volume-8079c327-d9d4-4721-91d0-9987e11825fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe 1073741824" returned: 0 in 0.380s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe" returned: 0 in 0.118s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587ce710-a752-4b16-b7dd-604f03d2811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8079c327-d9d4-4721-91d0-9987e11825fe', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f54558c-30dd-40a9-9458-06f66a8c4964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:27 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-8079c327-d9d4-4721-91d0-9987e11825fe (8079c327-d9d4-4721-91d0-9987e11825fe): created successfully
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f54558c-30dd-40a9-9458-06f66a8c4964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (36e81e97-96c1-42f8-8e18-4463f5457d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:27 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-35c9f99b-3ddf-4307-9ce0-2afa1e69ba49 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (da2677b1-076a-4512-b4ea-488d6a1e61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7186454-1c2e-43a0-8478-9dd2e14930a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7186454-1c2e-43a0-8478-9dd2e14930a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817170989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a725adf4-9c36-4240-9e4b-2de8e1a5aaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:30Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5f8a55-03fb-4e82-8969-35bbf33c257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5f8a55-03fb-4e82-8969-35bbf33c257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531696ff-9996-4b9b-9d9a-03eadd900414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531696ff-9996-4b9b-9d9a-03eadd900414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a725adf4-9c36-4240-9e4b-2de8e1a5aaea', 'volume_name': 'volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea1cb75-d9d4-43f1-899f-677f05020572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea1cb75-d9d4-43f1-899f-677f05020572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8326d4e0-420e-4964-bb41-81885906fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume a725adf4-9c36-4240-9e4b-2de8e1a5aaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea', 'volume_size': 1}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817170989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a725adf4-9c36-4240-9e4b-2de8e1a5aaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:30Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume a725adf4-9c36-4240-9e4b-2de8e1a5aaea {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:30 devstack quobyte-client[83978]: System call of process 100410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:30 devstack quobyte-client[83978]: System call of process 100410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:30 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=132, name=volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea 1073741824" returned: 0 in 0.532s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" returned: 0 in 0.188s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (782ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:31 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (523f9a0a-fb1f-4e4c-a1a3-019306c5093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cfc8cf-656a-4567-8d9a-51e48ea5e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cfc8cf-656a-4567-8d9a-51e48ea5e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369323635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c267a232-ec81-4345-a4e1-611f9a5dcd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:30Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02706c8-27bb-4cca-a75c-35c079785b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02706c8-27bb-4cca-a75c-35c079785b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48969e0-c7ab-4885-ba33-4ef91f196e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48969e0-c7ab-4885-ba33-4ef91f196e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c267a232-ec81-4345-a4e1-611f9a5dcd4e', 'volume_name': 'volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d71c4d-64c0-414d-ad08-dbb4d42932ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d71c4d-64c0-414d-ad08-dbb4d42932ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e8de13-7743-4789-b4da-32d714481bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:31 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume c267a232-ec81-4345-a4e1-611f9a5dcd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e', 'volume_size': 1}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369323635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c267a232-ec81-4345-a4e1-611f9a5dcd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:30Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume c267a232-ec81-4345-a4e1-611f9a5dcd4e {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:31 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:31 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=133, name=volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8326d4e0-420e-4964-bb41-81885906fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4101e02-f2ff-4be5-a814-655363aa3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e 1073741824" returned: 0 in 0.622s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (23d9fcf8-c799-4cc1-a655-2204c4aa83dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f3cd68-e5a1-4eb8-9443-710ad91cc295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (78d5d2f9-a4ec-4e4d-8484-7dd12a6100c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e3f50f-983d-4362-98f5-b0ce1525772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea (a725adf4-9c36-4240-9e4b-2de8e1a5aaea): created successfully
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4101e02-f2ff-4be5-a814-655363aa3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (da2677b1-076a-4512-b4ea-488d6a1e61ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f3cd68-e5a1-4eb8-9443-710ad91cc295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481657343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55508d18-c21e-4938-8ec2-7693a64698c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:31Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d92bc09-e1eb-4aff-abdd-6ee39e95c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d92bc09-e1eb-4aff-abdd-6ee39e95c31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7b642-be15-4536-89af-bf5f5e8c8a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7b642-be15-4536-89af-bf5f5e8c8a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55508d18-c21e-4938-8ec2-7693a64698c3', 'volume_name': 'volume-55508d18-c21e-4938-8ec2-7693a64698c3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f90acd-0ba9-445e-af4c-c15fcf559349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f90acd-0ba9-445e-af4c-c15fcf559349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09c4cdf-b687-40cc-9ae1-4815aa387b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume 55508d18-c21e-4938-8ec2-7693a64698c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55508d18-c21e-4938-8ec2-7693a64698c3', 'volume_size': 1}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e" returned: 0 in 0.731s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (1373ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481657343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55508d18-c21e-4938-8ec2-7693a64698c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:31Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume 55508d18-c21e-4938-8ec2-7693a64698c3 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:33 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:33 devstack quobyte-client[83978]: System call of process 100418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:33 devstack quobyte-client[83978]: System call of process 100418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:33 devstack quobyte-client[83978]: System call of process 100418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:33 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=134, name=volume-55508d18-c21e-4938-8ec2-7693a64698c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e3f50f-983d-4362-98f5-b0ce1525772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301233214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11a8257-055f-46dc-be46-cc02739b95f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:32Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f9fd9-653b-406b-9c8f-f37d29f99891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68f9fd9-653b-406b-9c8f-f37d29f99891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031eb032-d5a9-4ca7-85d7-18001ee09d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031eb032-d5a9-4ca7-85d7-18001ee09d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11a8257-055f-46dc-be46-cc02739b95f1', 'volume_name': 'volume-f11a8257-055f-46dc-be46-cc02739b95f1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631e58b-465c-4cb2-a844-97ee669c5778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631e58b-465c-4cb2-a844-97ee669c5778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f150c1b-83a5-4e34-b188-c163d974a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume f11a8257-055f-46dc-be46-cc02739b95f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11a8257-055f-46dc-be46-cc02739b95f1', 'volume_size': 1}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c36eed93-ed5b-4e0d-9f81-c4f02c11b2c4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (966b637f-f453-462a-832f-b02b515bd404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8f246-3597-40fe-a009-54066634c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e8de13-7743-4789-b4da-32d714481bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa276cc-4d0a-49ce-bb33-9b4e8826c274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3 1073741824" returned: 0 in 0.661s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8f246-3597-40fe-a009-54066634c558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101656360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4783e8-f386-4fdf-ba35-4a913dcfce45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:32Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7aa3f-ce60-4590-b8c5-d563d7cadb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7aa3f-ce60-4590-b8c5-d563d7cadb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51b6ce3-c9d2-487c-a7dc-80f2a53ea24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51b6ce3-c9d2-487c-a7dc-80f2a53ea24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4783e8-f386-4fdf-ba35-4a913dcfce45', 'volume_name': 'volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314437d0-a142-42f4-b981-351db9546f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314437d0-a142-42f4-b981-351db9546f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c04655f-89b7-4c64-b782-6714637f4594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume 3c4783e8-f386-4fdf-ba35-4a913dcfce45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45', 'volume_size': 1}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e (c267a232-ec81-4345-a4e1-611f9a5dcd4e): created successfully
Sep 25 20:08:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa276cc-4d0a-49ce-bb33-9b4e8826c274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (523f9a0a-fb1f-4e4c-a1a3-019306c5093e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3" returned: 0 in 0.360s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (1135ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301233214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11a8257-055f-46dc-be46-cc02739b95f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:32Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume f11a8257-055f-46dc-be46-cc02739b95f1 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-acc98305-88b7-43f4-b257-aa5a3e8a2112 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:34 devstack quobyte-client[83978]: System call of process 100422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:34 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=135, name=volume-f11a8257-055f-46dc-be46-cc02739b95f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09c4cdf-b687-40cc-9ae1-4815aa387b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55508d18-c21e-4938-8ec2-7693a64698c3', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b31795c-1cf6-4393-b290-01ad80a55a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1 1073741824" returned: 0 in 0.469s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-55508d18-c21e-4938-8ec2-7693a64698c3 (55508d18-c21e-4938-8ec2-7693a64698c3): created successfully
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b31795c-1cf6-4393-b290-01ad80a55a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (23d9fcf8-c799-4cc1-a655-2204c4aa83dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1" returned: 0 in 0.343s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101656360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4783e8-f386-4fdf-ba35-4a913dcfce45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7fb8552dc4ab29b65488dda02d277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:32Z,use_quota=True,user_id='91fa8959b1fe4258bce92f4ae18b9414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Creating volume 3c4783e8-f386-4fdf-ba35-4a913dcfce45 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:35 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:35 devstack quobyte-client[83978]: System call of process 100426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:35 devstack quobyte-client[83978]: System call of process 100426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:35 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=136, name=volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-54089978-527b-4402-8885-ea03c46e8521 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f150c1b-83a5-4e34-b188-c163d974a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11a8257-055f-46dc-be46-cc02739b95f1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa292b-36f0-488b-85b2-177aff45e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-f11a8257-055f-46dc-be46-cc02739b95f1 (f11a8257-055f-46dc-be46-cc02739b95f1): created successfully
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa292b-36f0-488b-85b2-177aff45e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (78d5d2f9-a4ec-4e4d-8484-7dd12a6100c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 1073741824" returned: 0 in 0.457s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c88a1361-9bb7-4eaf-94e3-3ebf00b286bc tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45" returned: 0 in 0.386s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] <== create_volume: return (869ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c04655f-89b7-4c64-b782-6714637f4594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7238390e-1bf7-4c5b-9cd5-6406b365c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:35 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Flow 'volume_create_manager' (d908eb39-e2e5-429f-8c2b-0df545f80aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7afe5-9b1a-43cb-b410-b44e7956c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:36 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 (3c4783e8-f386-4fdf-ba35-4a913dcfce45): created successfully
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7238390e-1bf7-4c5b-9cd5-6406b365c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Flow 'volume_create_manager' (966b637f-f453-462a-832f-b02b515bd404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7afe5-9b1a-43cb-b410-b44e7956c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15626f2-efc0-4a3a-b1fc-c22240ecb20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40eabe3a1264f36a9d04a190163c947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:36Z,use_quota=True,user_id='c54112c92b2f41198605d7e7873536fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba54c8c-2b6a-4e96-a381-3aaac92227ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba54c8c-2b6a-4e96-a381-3aaac92227ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7b5cb7-0402-4deb-a382-9b4aaa541760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7b5cb7-0402-4deb-a382-9b4aaa541760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15626f2-efc0-4a3a-b1fc-c22240ecb20f', 'volume_name': 'volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01f576-b353-4e7d-853b-ad2414655fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01f576-b353-4e7d-853b-ad2414655fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ea69c9-4368-41f2-96c6-97af1e89e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:36 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Volume f15626f2-efc0-4a3a-b1fc-c22240ecb20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f', 'volume_size': 1}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15626f2-efc0-4a3a-b1fc-c22240ecb20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40eabe3a1264f36a9d04a190163c947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:36Z,use_quota=True,user_id='c54112c92b2f41198605d7e7873536fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Creating volume f15626f2-efc0-4a3a-b1fc-c22240ecb20f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:36 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:36 devstack quobyte-client[83978]: System call of process 100430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:36 devstack quobyte-client[83978]: System call of process 100430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:36 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-11d08f4a-ed72-47d4-a0ea-f9aa0ce0e4ac tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created volume successfully.
Sep 25 20:08:36 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=137, name=volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-3c4783e8-f386-4fdf-ba35-4a913dcfce45-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-3c4783e8-f386-4fdf-ba35-4a913dcfce45-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:36 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-3c4783e8-f386-4fdf-ba35-4a913dcfce45" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f 1073741824" returned: 0 in 0.624s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-3c4783e8-f386-4fdf-ba35-4a913dcfce45" acquired by "delete_volume" :: waited 0.144s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9bb4c7-4e90-41f1-9fd7-67b906af8023]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" returned: 0 in 0.252s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ea69c9-4368-41f2-96c6-97af1e89e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6392086-f4c6-48b4-b71b-f64f7d440bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Volume volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f (f15626f2-efc0-4a3a-b1fc-c22240ecb20f): created successfully
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6392086-f4c6-48b4-b71b-f64f7d440bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Flow 'volume_create_manager' (d908eb39-e2e5-429f-8c2b-0df545f80aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9425893e-6fbc-4315-b1ae-3680f1c61aff tempest-CinderUnicodeTest-400962843 None] Created volume successfully.
Sep 25 20:08:37 devstack quobyte-client[83978]: System call of process 100435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45" returned: 0 in 0.510s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-3c4783e8-f386-4fdf-ba35-4a913dcfce45" returned: 0 in 0.097s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-3c4783e8-f386-4fdf-ba35-4a913dcfce45" released by "delete_volume" :: held 0.808s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['fbe1a3a2-1150-4826-8a32-41f68a103a34', '27acbc24-b3d5-46e7-8844-45debd67f6a1', '941a95bd-38ad-4f06-9142-51db65595180', '9ca3b076-12cd-4855-b950-5d5654e4b18e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:38 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-c0c41d96-2c86-4786-8da2-607eacaa709d tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-3c4783e8-f386-4fdf-ba35-4a913dcfce45-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Flow 'volume_create_manager' (bfdc2472-5831-47c6-b649-db37b6933e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19058f36-5e6e-4c9b-9a4a-6c726a288c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-f11a8257-055f-46dc-be46-cc02739b95f1-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19058f36-5e6e-4c9b-9a4a-6c726a288c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978860594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f0bcbd-17ad-4266-b2fd-05bd9830a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40eabe3a1264f36a9d04a190163c947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:38Z,use_quota=True,user_id='c54112c92b2f41198605d7e7873536fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadce35-6f09-469f-b4b0-02f18f0213a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadce35-6f09-469f-b4b0-02f18f0213a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cc90e7-a04a-4982-b951-912316ac1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cc90e7-a04a-4982-b951-912316ac1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f0bcbd-17ad-4266-b2fd-05bd9830a7a9', 'volume_name': 'volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d0fc6-0b67-4340-8fe3-c720b8dc164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d0fc6-0b67-4340-8fe3-c720b8dc164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd2ab78-9f06-404f-ae60-54fe610d7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Volume 09f0bcbd-17ad-4266-b2fd-05bd9830a7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9', 'volume_size': 1}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978860594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f0bcbd-17ad-4266-b2fd-05bd9830a7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40eabe3a1264f36a9d04a190163c947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:38Z,use_quota=True,user_id='c54112c92b2f41198605d7e7873536fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Creating volume 09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:08:38 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:08:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:39 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=138, name=volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-f11a8257-055f-46dc-be46-cc02739b95f1-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 1073741824" returned: 0 in 0.405s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" returned: 0 in 0.297s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:39 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-f11a8257-055f-46dc-be46-cc02739b95f1" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] <== create_volume: return (783ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd2ab78-9f06-404f-ae60-54fe610d7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3b641-4d11-4c25-bc12-84b485fb3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-f11a8257-055f-46dc-be46-cc02739b95f1" acquired by "delete_volume" :: waited 0.127s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c4407-38ac-4a9e-a641-193d70d93165]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Volume volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 (09f0bcbd-17ad-4266-b2fd-05bd9830a7a9): created successfully
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3b641-4d11-4c25-bc12-84b485fb3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Flow 'volume_create_manager' (bfdc2472-5831-47c6-b649-db37b6933e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:40 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0b649ded-84cf-47ba-9a5e-0e9af6b3b20e tempest-CinderUnicodeTest-400962843 None] Created volume successfully.
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1" returned: 0 in 0.507s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f11a8257-055f-46dc-be46-cc02739b95f1" returned: 0 in 0.112s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-f11a8257-055f-46dc-be46-cc02739b95f1" released by "delete_volume" :: held 0.760s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['8469639e-7e9e-4cf9-a5c6-b53394995ee9', '91e1b4fc-876e-46ec-a8c4-8c41b2d1a6b6', 'e70bcb8b-13af-4827-938b-b2f9a64f46f8', '0b387b45-b3ed-4f67-aec8-e53bf7bee832'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-55508d18-c21e-4938-8ec2-7693a64698c3-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.421s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-55508d18-c21e-4938-8ec2-7693a64698c3-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-09de271a-5b83-4438-9dd9-f88e95e3941b tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-f11a8257-055f-46dc-be46-cc02739b95f1-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-55508d18-c21e-4938-8ec2-7693a64698c3" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Creating offline snapshot 9dd47df7-1670-4289-8ea3-f48bb96cc658 of volume 09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e09507-0a88-4337-bf12-0285422fc8b0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-55508d18-c21e-4938-8ec2-7693a64698c3" acquired by "delete_volume" :: waited 0.135s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4adb46-a7bd-46ec-8a55-56bda7524ff9]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" returned: 0 in 0.503s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=139, name=volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3" returned: 0 in 0.600s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 1G" returned: 0 in 0.378s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): qemu-img rebase -u -b volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55508d18-c21e-4938-8ec2-7693a64698c3" returned: 0 in 0.193s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:42 devstack quobyte-client[83978]: System call of process 100461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "qemu-img rebase -u -b volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.179s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-55508d18-c21e-4938-8ec2-7693a64698c3" released by "delete_volume" :: held 1.134s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.283s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.260s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['7ad84ea4-0129-4b38-ade3-b6cd02352509', '1513322e-a396-497d-8873-29ae61d7e74d', '78e7e494-2bd3-4633-a73f-ea2c06090d1b', '46f749c7-8137-463c-8b1a-a67449f6194c'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.info" returned: 0 in 0.244s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.info" returned: 0 in 0.190s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-014cac48-0f1e-44d3-8295-b694d0aa0dfc tempest-CinderUnicodeTest-400962843 None] Create snapshot completed successfully
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.259s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-c267a232-ec81-4345-a4e1-611f9a5dcd4e-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-4ec38156-91f9-44c8-beb2-3259fc98aef8 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-55508d18-c21e-4938-8ec2-7693a64698c3-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-c267a232-ec81-4345-a4e1-611f9a5dcd4e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-c267a232-ec81-4345-a4e1-611f9a5dcd4e" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-c267a232-ec81-4345-a4e1-611f9a5dcd4e" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e215bb97-7bf4-4cad-81af-2d37fc934b72]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:45 devstack quobyte-client[83978]: System call of process 100469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:45 devstack quobyte-client[83978]: System call of process 100469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e" returned: 0 in 0.430s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-9dd47df7-1670-4289-8ea3-f48bb96cc658-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c267a232-ec81-4345-a4e1-611f9a5dcd4e" returned: 0 in 0.289s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-9dd47df7-1670-4289-8ea3-f48bb96cc658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-c267a232-ec81-4345-a4e1-611f9a5dcd4e" released by "delete_volume" :: held 0.854s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" acquired by "delete_snapshot" :: waited 0.132s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-quobyte-9dd47df7-1670-4289-8ea3-f48bb96cc658" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-9dd47df7-1670-4289-8ea3-f48bb96cc658" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Deleting offline snapshot 9dd47df7-1670-4289-8ea3-f48bb96cc658 of volume 09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] snapshot_file for this snap is: volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc5b5f8-d19b-4746-9443-699d32a39e5b]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['44b2dd0d-48cb-490b-b9fb-7bcaaeed019d', '57743290-1f59-44d1-9d85-cb4451efa5d9', '7605d010-208d-4737-b75e-23ccac7f383e', '41e75f59-187c-4464-b68c-56ce4974dfdd'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.641s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.188s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a205e1-bb76-4927-a718-7516b8c0b64f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:46 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-a725adf4-9c36-4240-9e4b-2de8e1a5aaea-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-a725adf4-9c36-4240-9e4b-2de8e1a5aaea-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95f3fbb2-ada8-4dd4-a1c9-4f1fe63ee6a4 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-c267a232-ec81-4345-a4e1-611f9a5dcd4e-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:47 devstack quobyte-client[83978]: System call of process 100478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:47 devstack quobyte-client[83978]: System call of process 100478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:47 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" returned: 0 in 0.616s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:47 devstack quobyte-client[83978]: System call of process 100481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" acquired by "delete_volume" :: waited 0.254s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.286s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6700371e-52ad-4819-b286-eff640d65afb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9.9dd47df7-1670-4289-8ea3-f48bb96cc658" returned: 0 in 0.224s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-9dd47df7-1670-4289-8ea3-f48bb96cc658" released by "_delete_snapshot" :: held 2.209s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" released by "delete_snapshot" :: held 2.259s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" returned: 0 in 0.564s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" returned: 0 in 0.225s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-a725adf4-9c36-4240-9e4b-2de8e1a5aaea" released by "delete_volume" :: held 1.051s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Created reservations ['07689c5f-a475-4536-9b8c-6cb6b15e4e7f', 'f6e95d50-ced4-4d66-96db-51104564f6df', '232e7333-ed76-4df5-91e4-ebcc29c0a464', 'b24c807f-d076-4361-b1f4-abed8a16faaa'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['a8506c1f-3f44-4e23-9959-dd54b80bd0b8', '870ad05e-8f30-4493-9c04-20473463da34', '21150e5a-1df8-4bc0-a433-f33ad3f03f31', 'db903e4d-dba7-44ad-bffb-37fdb7cc9f22'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Delete snapshot completed successfully.
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ef36202f-80e1-4743-89d4-c08b6b5bd447 tempest-CinderUnicodeTest-400962843 None] Lock "cinder-9dd47df7-1670-4289-8ea3-f48bb96cc658-delete_snapshot" released by "delete_snapshot" :: held 3.271s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.089s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-8079c327-d9d4-4721-91d0-9987e11825fe-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-8079c327-d9d4-4721-91d0-9987e11825fe-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a9e3e1ce-7ee8-4228-b9d1-ffc2af9d370c tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-a725adf4-9c36-4240-9e4b-2de8e1a5aaea-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "cinder-quobyte-8079c327-d9d4-4721-91d0-9987e11825fe" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-8079c327-d9d4-4721-91d0-9987e11825fe" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f994be-a32e-4071-8aa7-adf308263872]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "cinder-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe" returned: 0 in 0.626s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8079c327-d9d4-4721-91d0-9987e11825fe" returned: 0 in 0.193s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" acquired by "delete_volume" :: waited 0.244s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e3a1c-a257-4f47-b98a-6fbfa70b0617]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-quobyte-8079c327-d9d4-4721-91d0-9987e11825fe" released by "delete_volume" :: held 1.062s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Created reservations ['0b648f2c-869a-40c3-94f6-b438439a9510', 'b91a53b3-2689-46d3-8abd-210c96534d10', '921a7128-a4d5-4d21-9feb-493b78fbe35e', '78a4f02a-7384-4b6d-8890-7207774d1c47'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:51 devstack quobyte-client[83978]: System call of process 100502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:51 devstack quobyte-client[83978]: System call of process 100502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:51 devstack quobyte-client[83978]: System call of process 100502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:51 devstack quobyte-client[83978]: System call of process 100502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" returned: 0 in 0.552s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" returned: 0 in 0.292s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9" released by "delete_volume" :: held 1.014s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Created reservations ['3b3cd12b-5103-4c74-b704-2b1494630a29', '236cf3f3-8c8c-4d66-a9ec-f2d8f854080f', 'd9066839-3ed7-4183-b243-974dc9388534', 'c0cb9d80-fa7f-414b-a399-b66ae5896a27'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.348s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:52 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Deleted volume successfully.
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.212s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:52 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Deleted volume successfully.
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-dc87025a-900b-4816-b970-d8a86f124408 tempest-CreateVolumesFromSourceVolumeTest-2032311175 None] Lock "cinder-8079c327-d9d4-4721-91d0-9987e11825fe-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-17c8ed71-0c59-41bf-96e2-6248a419112a tempest-CinderUnicodeTest-400962843 None] Lock "cinder-09f0bcbd-17ad-4266-b2fd-05bd9830a7a9-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-f15626f2-efc0-4a3a-b1fc-c22240ecb20f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "cinder-f15626f2-efc0-4a3a-b1fc-c22240ecb20f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:53 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Acquiring lock "cinder-quobyte-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" acquired by "delete_volume" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2bf2b6-a503-4b25-83b0-f208d10ff6ae]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" returned: 0 in 0.485s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" returned: 0 in 0.096s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "cinder-quobyte-f15626f2-efc0-4a3a-b1fc-c22240ecb20f" released by "delete_volume" :: held 0.772s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Created reservations ['dd043292-4bb9-4268-848c-189e4dac4d97', 'b03f3257-e503-4343-b8dc-92ce4a812301', '1abd60a0-3128-4927-bb72-20b8f159c661', 'abf37ed9-49e1-4c9f-a6d9-579a2355dc50'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:08:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.346s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Deleted volume successfully.
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.443s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:08:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-acb03a2e-0be7-4efa-93df-75fc2c70f13f tempest-CinderUnicodeTest-400962843 None] Lock "cinder-f15626f2-efc0-4a3a-b1fc-c22240ecb20f-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:08:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Flow 'volume_create_manager' (3d10308e-ec14-41f6-8de6-c358e8234ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24633180-7fb7-4e09-b209-7b04ea27eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24633180-7fb7-4e09-b209-7b04ea27eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d2217c-2d68-4df5-8361-ba6be2490d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e51a14ed8246da872c9a58e4163fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:58Z,use_quota=True,user_id='094cf8e0d1a14c1badd770b4ef65b304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa686a25-bb6f-4336-9a6b-ae900773610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa686a25-bb6f-4336-9a6b-ae900773610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1be03-9638-4ffb-9c24-2c05c3646061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1be03-9638-4ffb-9c24-2c05c3646061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66d2217c-2d68-4df5-8361-ba6be2490d68', 'volume_name': 'volume-66d2217c-2d68-4df5-8361-ba6be2490d68', 'volume_size': 1, 'image_id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4707601f0f954c9b4f718e8a11d3649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4e51a14ed8246da872c9a58e4163fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18bc5e7b52eec5a7e9f6675543ece1e4f99b8809d84d5cc329f749967cf1bbee09eeceb8d2182be67b799f86b6b8202a6206eaee442773865a47dff127a8c84f', 'id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'created_at': datetime.datetime(2025, 9, 25, 18, 8, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97906b35e0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77c12-800d-4d81-862a-86b1f2101dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77c12-800d-4d81-862a-86b1f2101dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e4ac0-a291-4642-b8c8-8ea31105cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:08:58 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Volume 66d2217c-2d68-4df5-8361-ba6be2490d68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66d2217c-2d68-4df5-8361-ba6be2490d68', 'volume_size': 1, 'image_id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4707601f0f954c9b4f718e8a11d3649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4e51a14ed8246da872c9a58e4163fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18bc5e7b52eec5a7e9f6675543ece1e4f99b8809d84d5cc329f749967cf1bbee09eeceb8d2182be67b799f86b6b8202a6206eaee442773865a47dff127a8c84f', 'id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'created_at': datetime.datetime(2025, 9, 25, 18, 8, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97906b35e0>}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Cloning 66d2217c-2d68-4df5-8361-ba6be2490d68 from image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167  at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 20:08:58 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc443c-20e2-4df4-b526-24b2200f0750]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:08:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:08:59 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD
Sep 25 20:08:59 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:09:01 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Sep 25 20:09:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 0 in 2.165s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:01 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD
Sep 25 20:09:01 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:09:03 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Sep 25 20:09:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 1 in 1.915s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:03 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Temporary image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 is fetched for user 094cf8e0d1a14c1badd770b4ef65b304. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 20:09:03 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c80ee17-c34a-4fae-8577-8be059db79a2]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:03 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD
Sep 25 20:09:03 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:09:05 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Sep 25 20:09:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 0 in 1.866s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:05 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD
Sep 25 20:09:05 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:09:07 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 1 in 1.883s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d2217c-2d68-4df5-8361-ba6be2490d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e51a14ed8246da872c9a58e4163fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:08:58Z,use_quota=True,user_id='094cf8e0d1a14c1badd770b4ef65b304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Creating volume 66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:09:07 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:07 devstack quobyte-client[83978]: System call of process 100570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:07 devstack quobyte-client[83978]: System call of process 100570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:07 devstack quobyte-client[83978]: System call of process 100570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:07 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=141, name=volume-66d2217c-2d68-4df5-8361-ba6be2490d68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 1073741824" returned: 0 in 0.305s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 0 in 0.085s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] <== create_volume: return (481ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:09:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Attempting download of 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}])) to volume 66d2217c-2d68-4df5-8361-ba6be2490d68. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c2497-8943-4d20-bbbe-a9048bf36d8b]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_j17k3ik2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_j17k3ik2" returned: 0 in 0.336s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_j17k3ik2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_j17k3ik2" returned: 1 in 0.361s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_j17k3ik2' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bdb5a7-1f96-44a3-8329-5a8b5d5fa560]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 was raw, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:09 devstack quobyte-client[83978]: System call of process 100583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:09 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=141, name=volume-66d2217c-2d68-4df5-8361-ba6be2490d68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 0 in 0.154s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e0f933a-b8c7-4c9a-b2e1-cc1119dca167_56k879p7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:09:09 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 20:09:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 1G" returned: 0 in 0.143s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88eefb8-b987-44bc-a207-31761ada432d]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 0 in 0.357s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 1 in 0.359s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Downloaded image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}])) to volume 66d2217c-2d68-4df5-8361-ba6be2490d68 successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Temporary image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 for user 094cf8e0d1a14c1badd770b4ef65b304 is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 20:09:10 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Marking volume 66d2217c-2d68-4df5-8361-ba6be2490d68 as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Copying metadata from image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 to 66d2217c-2d68-4df5-8361-ba6be2490d68. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Creating volume glance metadata for volume 66d2217c-2d68-4df5-8361-ba6be2490d68 backed by image 3e0f933a-b8c7-4c9a-b2e1-cc1119dca167 with: {'image_id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e4707601f0f954c9b4f718e8a11d3649', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8e4ac0-a291-4642-b8c8-8ea31105cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d2217c-2d68-4df5-8361-ba6be2490d68', 'volume_size': 1, 'image_id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4707601f0f954c9b4f718e8a11d3649', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4e51a14ed8246da872c9a58e4163fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18bc5e7b52eec5a7e9f6675543ece1e4f99b8809d84d5cc329f749967cf1bbee09eeceb8d2182be67b799f86b6b8202a6206eaee442773865a47dff127a8c84f', 'id': '3e0f933a-b8c7-4c9a-b2e1-cc1119dca167', 'created_at': datetime.datetime(2025, 9, 25, 18, 8, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e0f933a-b8c7-4c9a-b2e1-cc1119dca167/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97906b35e0>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec50818-c9be-4a8d-8f3c-692b27ca8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:11 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Volume volume-66d2217c-2d68-4df5-8361-ba6be2490d68 (66d2217c-2d68-4df5-8361-ba6be2490d68): created successfully
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec50818-c9be-4a8d-8f3c-692b27ca8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:11 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Flow 'volume_create_manager' (3d10308e-ec14-41f6-8de6-c358e8234ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:09:11 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d7b0181b-fb5c-492a-9202-5531e066838a tempest-VolumeImageDependencyTests-165748730 None] Created volume successfully.
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Acquiring lock "cinder-66d2217c-2d68-4df5-8361-ba6be2490d68-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "cinder-66d2217c-2d68-4df5-8361-ba6be2490d68-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:12 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Acquiring lock "cinder-quobyte-66d2217c-2d68-4df5-8361-ba6be2490d68" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "cinder-quobyte-66d2217c-2d68-4df5-8361-ba6be2490d68" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560663a-21de-46af-8d5b-07768c7344b1]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 0 in 0.353s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 1 in 0.365s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66d2217c-2d68-4df5-8361-ba6be2490d68" returned: 0 in 0.090s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:13 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "cinder-quobyte-66d2217c-2d68-4df5-8361-ba6be2490d68" released by "delete_volume" :: held 1.053s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Created reservations ['16800c69-6731-46ee-8f3c-0ef0c2c30b6d', '4f8389ad-563f-4aa3-8301-c79041742a3f', 'cc430a62-d466-4de7-8d4c-4131f1ea46df', '355f56e4-2408-4de1-b99c-e3132bd4152d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:09:14 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Deleted volume successfully.
Sep 25 20:09:14 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a3a509e4-be93-4b07-b1b9-97266584e935 tempest-VolumeImageDependencyTests-165748730 None] Lock "cinder-66d2217c-2d68-4df5-8361-ba6be2490d68-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=87,cinder:DELETE=9,cinder:SELECT=61,cinder:INSERT=19 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:09:24 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=70,cinder:UPDATE=109,cinder:DELETE=10,cinder:INSERT=30 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:09:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Flow 'volume_create_manager' (93f0b69d-f4aa-4867-b206-a9fddafed63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fe949-6512-4a60-b6cb-88ac491cdc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fe949-6512-4a60-b6cb-88ac491cdc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-942170242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d2f6e5-c5fb-4d60-837e-fcf11594faa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac8a3816f742febf93cf649f5c1499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:09:33Z,use_quota=True,user_id='3e529eea160f45ef9b879de17292c31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3d4b1-3a1f-49ac-b308-112e49146e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3d4b1-3a1f-49ac-b308-112e49146e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104ea2b4-9d35-4735-9d23-80016fe961e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104ea2b4-9d35-4735-9d23-80016fe961e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d2f6e5-c5fb-4d60-837e-fcf11594faa8', 'volume_name': 'volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1404f0b-81c7-49b8-a593-e5286a208ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1404f0b-81c7-49b8-a593-e5286a208ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab22e39c-67ed-4eef-866f-43235dda70a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Volume e3d2f6e5-c5fb-4d60-837e-fcf11594faa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8', 'volume_size': 1}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-942170242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d2f6e5-c5fb-4d60-837e-fcf11594faa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac8a3816f742febf93cf649f5c1499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:09:33Z,use_quota=True,user_id='3e529eea160f45ef9b879de17292c31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Creating volume e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:09:33 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:33 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=142, name=volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 1073741824" returned: 0 in 0.369s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.101s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.557s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab22e39c-67ed-4eef-866f-43235dda70a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c661ba-5bce-40d9-ab77-71c30b7b9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Volume volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 (e3d2f6e5-c5fb-4d60-837e-fcf11594faa8): created successfully
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c661ba-5bce-40d9-ab77-71c30b7b9e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Flow 'volume_create_manager' (93f0b69d-f4aa-4867-b206-a9fddafed63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:09:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-16a7ea73-a1b2-4078-8c6f-45e5892878b4 tempest-SnapshotDependencyTests-572629145 None] Created volume successfully.
Sep 25 20:09:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:35 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Creating offline snapshot 9d22d594-ba06-4126-be7a-ba38835e6720 of volume e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:09:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c9b52-6d2a-4875-8c71-3803340bfb24]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.388s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:36 devstack quobyte-client[83978]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:36 devstack quobyte-client[83978]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:36 devstack quobyte-client[83978]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:36 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=143, name=volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 1G" returned: 0 in 0.238s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "qemu-img rebase -u -b volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.131s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:09:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.122s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.info" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.info" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.450s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-457299ad-f4a9-4ee5-8281-973ca6f18b10 tempest-SnapshotDependencyTests-572629145 None] Create snapshot completed successfully
Sep 25 20:09:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Flow 'volume_create_manager' (ebabb4b4-0088-4285-a39b-352276837d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32dcb0e-df5d-401e-8169-8613b9cbc218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32dcb0e-df5d-401e-8169-8613b9cbc218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184ad713-099f-45f2-8e0c-2fbf1b6b03c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbac8a3816f742febf93cf649f5c1499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d22d594-ba06-4126-be7a-ba38835e6720,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:09:38Z,use_quota=True,user_id='3e529eea160f45ef9b879de17292c31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ed74d1-c1df-478f-985b-77a202f556c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ed74d1-c1df-478f-985b-77a202f556c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd10795c-855d-4b02-9258-997982fa90f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd10795c-855d-4b02-9258-997982fa90f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '184ad713-099f-45f2-8e0c-2fbf1b6b03c5', 'volume_name': 'volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5', 'volume_size': 1, 'snapshot_id': '9d22d594-ba06-4126-be7a-ba38835e6720'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6fae70-de12-4156-80a2-f3482d04fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6fae70-de12-4156-80a2-f3482d04fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c1d4b-b769-4f2f-9e85-6874c2c13627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Volume 184ad713-099f-45f2-8e0c-2fbf1b6b03c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5', 'volume_size': 1, 'snapshot_id': '9d22d594-ba06-4126-be7a-ba38835e6720'}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" by "_create_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Creating volume 184ad713-099f-45f2-8e0c-2fbf1b6b03c5 from snapshot 9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" by "_copy_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] snapshot: 9d22d594-ba06-4126-be7a-ba38835e6720, volume: 184ad713-099f-45f2-8e0c-2fbf1b6b03c5,  {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e4ffc4-3bdc-436a-a5f9-977002f77568]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.378s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Creating direct copy from snapshot {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d461b4e-cedc-4491-ae5f-42c9cbbab61d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:39 devstack quobyte-client[83978]: System call of process 100624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.450s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG cinder.utils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 not found in is_blk_device check {{(pid=83952) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 25 20:09:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:39 devstack quobyte-client[83978]: System call of process 100627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:39 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=145, name=volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:09:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" returned: 0 in 4.329s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:43 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[119cc64a-f1bf-4bc2-8815-d3357dcdfa31]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.538s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:09:44 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Converted 1024.00 MB image at 235.15 MB/s
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" returned: 0 in 0.081s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" released by "_copy_volume_from_snapshot" :: held 6.152s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" released by "_create_volume_from_snapshot" :: held 6.189s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.210s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c1d4b-b769-4f2f-9e85-6874c2c13627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5', 'volume_size': 1, 'snapshot_id': '9d22d594-ba06-4126-be7a-ba38835e6720'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9a46e8-9bae-46c2-895b-6a96646559b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:09:45 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Volume volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 (184ad713-099f-45f2-8e0c-2fbf1b6b03c5): created successfully
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9a46e8-9bae-46c2-895b-6a96646559b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Flow 'volume_create_manager' (ebabb4b4-0088-4285-a39b-352276837d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:09:45 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b1bc00f7-eb08-49e9-bd6b-eeb04997863f tempest-SnapshotDependencyTests-572629145 None] Created volume successfully.
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-9d22d594-ba06-4126-be7a-ba38835e6720-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-9d22d594-ba06-4126-be7a-ba38835e6720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Deleting offline snapshot 9d22d594-ba06-4126-be7a-ba38835e6720 of volume e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] snapshot_file for this snap is: volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[87065262-5f75-4d64-ac90-e98d56b89f69]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:45 devstack quobyte-client[83978]: System call of process 100641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:45 devstack quobyte-client[83978]: System call of process 100641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:09:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.367s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ca0fd-e490-49b0-935d-cc8b26f6edab]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.380s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.232s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8.9d22d594-ba06-4126-be7a-ba38835e6720" returned: 0 in 0.087s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-9d22d594-ba06-4126-be7a-ba38835e6720" released by "_delete_snapshot" :: held 1.335s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" released by "delete_snapshot" :: held 1.357s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Created reservations ['a1a468b7-8aee-4485-a5a2-3ef6834b7dfd', '654ee6d1-9f0b-4590-ba0a-c29372643b0a', 'fd338ede-cb32-4ed0-9fea-d0620bfe7ad7', '522388f1-85de-4447-9c2a-4ffe87bd7774'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:09:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Delete snapshot completed successfully.
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e38c2713-10d1-4502-a937-11f2f5b15288 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-9d22d594-ba06-4126-be7a-ba38835e6720-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:47 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" acquired by "delete_volume" :: waited 0.019s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ced5b-7eff-4238-86ec-f02acfb3c29f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.385s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" returned: 0 in 0.107s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8" released by "delete_volume" :: held 0.658s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Created reservations ['4dd241e2-eaf2-44bd-863c-ff89e6062da3', 'df18c9ea-d77a-4673-8363-f4b13784d6be', '5d6bc373-7d6a-4506-91bf-e0106fff6e69', '912e9408-30e2-42af-a892-53e6d48892a4'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:49 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:09:49 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Deleted volume successfully.
Sep 25 20:09:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-71c43154-4957-4135-befa-ccffc0cf4439 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-e3d2f6e5-c5fb-4d60-837e-fcf11594faa8-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-184ad713-099f-45f2-8e0c-2fbf1b6b03c5-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-184ad713-099f-45f2-8e0c-2fbf1b6b03c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:50 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" acquired by "delete_volume" :: waited 0.012s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed56868-3b8f-4b84-8144-bf12ec7669e0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" returned: 0 in 0.414s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" returned: 0 in 0.084s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-quobyte-184ad713-099f-45f2-8e0c-2fbf1b6b03c5" released by "delete_volume" :: held 0.660s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Created reservations ['2fb7bc9a-b20e-4f45-af96-8ebd2e1f9ac3', '87eb9166-cea6-4a0b-a834-81ea11b94a18', 'd7c240a3-a091-4e54-8f16-786dbfc42996', '659a99e7-d4bb-464c-994f-f2413dd86e00'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.088s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:09:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Deleted volume successfully.
Sep 25 20:09:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-06695b49-b118-4982-8fa5-d47e770c0757 tempest-SnapshotDependencyTests-572629145 None] Lock "cinder-184ad713-099f-45f2-8e0c-2fbf1b6b03c5-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:09:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:09:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.137s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:09:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:01 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=27,cinder:SELECT=14,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:10:01 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=7 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:10:24 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (a63bf6bf-ee18-4a49-9680-add80e7101ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224b2bc2-b14c-4979-bd17-8be234924b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224b2bc2-b14c-4979-bd17-8be234924b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593023416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b46b84-add1-4cbf-b1e6-99e3a4747971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3664ed67-d6dd-48bf-89ae-eed61dd28bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3664ed67-d6dd-48bf-89ae-eed61dd28bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e26c641-da57-4075-a992-501fa8b1d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e26c641-da57-4075-a992-501fa8b1d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b46b84-add1-4cbf-b1e6-99e3a4747971', 'volume_name': 'volume-28b46b84-add1-4cbf-b1e6-99e3a4747971', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7ea6a-3525-4610-8d8a-d15c6f60faba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e7ea6a-3525-4610-8d8a-d15c6f60faba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57169f50-04da-4019-884a-06089722096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:24 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume 28b46b84-add1-4cbf-b1e6-99e3a4747971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b46b84-add1-4cbf-b1e6-99e3a4747971', 'volume_size': 1}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593023416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b46b84-add1-4cbf-b1e6-99e3a4747971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume 28b46b84-add1-4cbf-b1e6-99e3a4747971 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:24 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:24 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=146, name=volume-28b46b84-add1-4cbf-b1e6-99e3a4747971, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (5106cf4f-104d-4781-82aa-8c8f3299fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573f0c84-186e-494e-b981-bd36758d59db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573f0c84-186e-494e-b981-bd36758d59db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114831025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d45d1a-9f37-40c6-b265-4a2707662b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc13c35-889e-4621-8982-457bee4ea7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc13c35-889e-4621-8982-457bee4ea7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3226f2ec-b38e-42c0-8b79-2431585ad148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3226f2ec-b38e-42c0-8b79-2431585ad148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d45d1a-9f37-40c6-b265-4a2707662b84', 'volume_name': 'volume-55d45d1a-9f37-40c6-b265-4a2707662b84', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7c62f7-1394-43c1-8d11-fb14cfe334be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7c62f7-1394-43c1-8d11-fb14cfe334be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271756c0-3c95-406f-9eee-c11e69e6a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:25 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Volume 55d45d1a-9f37-40c6-b265-4a2707662b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d45d1a-9f37-40c6-b265-4a2707662b84', 'volume_size': 1}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 1073741824" returned: 0 in 1.023s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (9811aa2d-0791-4e41-b39b-2c0bfc5a7cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ada0b8-9359-4006-a294-ededfcd61fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (75109c5b-958b-48bb-bc23-cb85cb0b5679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96573a76-91c1-4fe3-aa2c-a16e208b97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (6c77d927-bd4d-4405-9da1-16719cedfbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b989b33-7198-4e90-9711-654e83133ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96573a76-91c1-4fe3-aa2c-a16e208b97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714506590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a13a6d-8487-41ad-ba10-440fb27b90ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:26Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b0e3e2-f055-49af-810a-a77d620f58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b0e3e2-f055-49af-810a-a77d620f58ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473abdbc-5c25-491e-89d6-567b0e79ff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473abdbc-5c25-491e-89d6-567b0e79ff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a13a6d-8487-41ad-ba10-440fb27b90ea', 'volume_name': 'volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f8ef16-28fa-418d-be9c-e0fa1d3c310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f8ef16-28fa-418d-be9c-e0fa1d3c310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf03b1f-3971-4ce4-8eea-fc2a5c55ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Volume c8a13a6d-8487-41ad-ba10-440fb27b90ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea', 'volume_size': 1}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ada0b8-9359-4006-a294-ededfcd61fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918070953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9336efbf-041f-4bd5-b2f2-69f2795a923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:25Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ebd7c9-8f31-40cd-bb93-7a694913cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ebd7c9-8f31-40cd-bb93-7a694913cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38afcef6-2b8f-4aa0-be37-88190d1ab205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38afcef6-2b8f-4aa0-be37-88190d1ab205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9336efbf-041f-4bd5-b2f2-69f2795a923a', 'volume_name': 'volume-9336efbf-041f-4bd5-b2f2-69f2795a923a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ed2ab9-cba5-4a63-8e18-67723db2282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ed2ab9-cba5-4a63-8e18-67723db2282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab42473f-48c4-4ace-be7c-fcc07a230b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Volume 9336efbf-041f-4bd5-b2f2-69f2795a923a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9336efbf-041f-4bd5-b2f2-69f2795a923a', 'volume_size': 1}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971" returned: 0 in 0.724s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b989b33-7198-4e90-9711-654e83133ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324713452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2cca2c-5882-40b7-9903-a8616f8d295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5745a49-3a06-4358-81cb-9ea94e2bc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5745a49-3a06-4358-81cb-9ea94e2bc08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7aa8d5-365c-424e-8eeb-dcfa2e0eb90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7aa8d5-365c-424e-8eeb-dcfa2e0eb90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2cca2c-5882-40b7-9903-a8616f8d295f', 'volume_name': 'volume-cc2cca2c-5882-40b7-9903-a8616f8d295f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf916d7d-81cb-43ee-95e1-50af52deed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf916d7d-81cb-43ee-95e1-50af52deed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accf1dca-4399-4142-9375-cd286e0e6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:26 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Volume cc2cca2c-5882-40b7-9903-a8616f8d295f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2cca2c-5882-40b7-9903-a8616f8d295f', 'volume_size': 1}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1799ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114831025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d45d1a-9f37-40c6-b265-4a2707662b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Creating volume 55d45d1a-9f37-40c6-b265-4a2707662b84 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:26 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:26 devstack quobyte-client[83978]: System call of process 100763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:26 devstack quobyte-client[83978]: System call of process 100763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:26 devstack quobyte-client[83978]: System call of process 100763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:26 devstack quobyte-client[83978]: System call of process 100763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:26 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=147, name=volume-55d45d1a-9f37-40c6-b265-4a2707662b84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:26 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (cc4f2328-d8de-414e-a0c2-cc1501362a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a71f0ba-3e35-4ed8-8858-57c56a8cdb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a71f0ba-3e35-4ed8-8858-57c56a8cdb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-151305229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89b1056-a47f-4ca7-a6c0-3567ddc01b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:26Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49c91eb-606b-4115-b944-f522dd33bcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49c91eb-606b-4115-b944-f522dd33bcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc267c7-264a-43d7-bc97-b3cea6fc7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc267c7-264a-43d7-bc97-b3cea6fc7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89b1056-a47f-4ca7-a6c0-3567ddc01b5b', 'volume_name': 'volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb96572-696e-4ed8-974e-a161573d5bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb96572-696e-4ed8-974e-a161573d5bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00e18e2-632d-4095-8a57-841157316c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Volume a89b1056-a47f-4ca7-a6c0-3567ddc01b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b', 'volume_size': 1}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57169f50-04da-4019-884a-06089722096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b46b84-add1-4cbf-b1e6-99e3a4747971', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa042ceb-ecae-4d34-8124-f7843fbe5922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84 1073741824" returned: 0 in 0.639s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:27 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 (28b46b84-add1-4cbf-b1e6-99e3a4747971): created successfully
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa042ceb-ecae-4d34-8124-f7843fbe5922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (a63bf6bf-ee18-4a49-9680-add80e7101ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84" returned: 0 in 0.432s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714506590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a13a6d-8487-41ad-ba10-440fb27b90ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:26Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Creating volume c8a13a6d-8487-41ad-ba10-440fb27b90ea {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:27 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:27 devstack quobyte-client[83978]: System call of process 100768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:27 devstack quobyte-client[83978]: System call of process 100768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:27 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=148, name=volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:28 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Flow 'volume_create_manager' (118a2d34-8554-457a-98d7-2fc15dfb9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb068f2c-be45-4dac-b7cb-37cc70fc83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:28 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-429272b3-2e62-4374-8e23-f866d65596c6 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb068f2c-be45-4dac-b7cb-37cc70fc83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f6adf2-f7cf-4da7-826a-be087a766fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def11c22ec14105963af9025a22d4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:27Z,use_quota=True,user_id='773586f2e69b454caec56b4416d6faa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aa928-1509-4af2-96eb-3c170d1729d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aa928-1509-4af2-96eb-3c170d1729d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec00ca5-a5d5-4ee1-b4be-d30a9737acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.image.glance [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Creating Keystone auth plugin from conf {{(pid=83952) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271756c0-3c95-406f-9eee-c11e69e6a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d45d1a-9f37-40c6-b265-4a2707662b84', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da960363-d9cf-4ee3-8b98-6761c9a8588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea 1073741824" returned: 0 in 0.817s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:28 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (18b63ff9-48bf-4de2-9a66-d08d43e8d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8af24d0-4006-4692-8c07-bc129cf3177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:28 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Volume volume-55d45d1a-9f37-40c6-b265-4a2707662b84 (55d45d1a-9f37-40c6-b265-4a2707662b84): created successfully
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da960363-d9cf-4ee3-8b98-6761c9a8588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:28 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (5106cf4f-104d-4781-82aa-8c8f3299fe00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-3fbad274-2a35-48cc-91e9-5169671ebdcf tempest-CreateVolumesFromImageTest-1874382015 None] Created volume successfully.
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8af24d0-4006-4692-8c07-bc129cf3177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-284757956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9668e1b-7033-4a66-baba-b0c87648ef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:28Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feb052e-b92f-4746-82ee-024db16354fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feb052e-b92f-4746-82ee-024db16354fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67efc05-38ac-4867-826b-47f542a4cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67efc05-38ac-4867-826b-47f542a4cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9668e1b-7033-4a66-baba-b0c87648ef35', 'volume_name': 'volume-b9668e1b-7033-4a66-baba-b0c87648ef35', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547846dc-4cf9-4d13-854b-7ecd8b428170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547846dc-4cf9-4d13-854b-7ecd8b428170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecc020d-a02e-4407-8b0a-dd9e5a2ce1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume b9668e1b-7033-4a66-baba-b0c87648ef35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9668e1b-7033-4a66-baba-b0c87648ef35', 'volume_size': 1}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea" returned: 0 in 0.613s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (316bee07-9a14-4055-a781-aeab8296b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04bbf53-b244-406f-9824-2d9b9efb29ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] <== create_volume: return (1553ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918070953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9336efbf-041f-4bd5-b2f2-69f2795a923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:25Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Creating volume 9336efbf-041f-4bd5-b2f2-69f2795a923a {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:29 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:29 devstack quobyte-client[83978]: System call of process 100772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:29 devstack quobyte-client[83978]: System call of process 100772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:29 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=149, name=volume-9336efbf-041f-4bd5-b2f2-69f2795a923a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04bbf53-b244-406f-9824-2d9b9efb29ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-975476997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457f79e7-fe32-4a76-baef-12d62543eec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:28Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6b2640-52e0-44c4-a0af-3067510e5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6b2640-52e0-44c4-a0af-3067510e5d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786edf6-a190-42ea-a379-73f618d1e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5786edf6-a190-42ea-a379-73f618d1e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457f79e7-fe32-4a76-baef-12d62543eec9', 'volume_name': 'volume-457f79e7-fe32-4a76-baef-12d62543eec9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9533959c-d2cc-48ee-94c6-a85ac40ff2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9533959c-d2cc-48ee-94c6-a85ac40ff2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94764f1b-fce4-45f3-b6d2-08e297080e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume 457f79e7-fe32-4a76-baef-12d62543eec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457f79e7-fe32-4a76-baef-12d62543eec9', 'volume_size': 1}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (39d7b3da-07ef-4a87-a173-96f84e2de838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdb3acd-fff3-4607-b0d2-f9f4bd54cb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf03b1f-3971-4ce4-8eea-fc2a5c55ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:29 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9aee38-ec7d-4054-92f9-931f477bd189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdb3acd-fff3-4607-b0d2-f9f4bd54cb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2124872802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba07615-74a1-4fcf-bf91-05ff10a0fedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7dbfdf-7f45-4d9e-85e9-8cd9936b4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7dbfdf-7f45-4d9e-85e9-8cd9936b4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b8c738-dff4-41db-9c78-3cd1990e02b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b8c738-dff4-41db-9c78-3cd1990e02b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba07615-74a1-4fcf-bf91-05ff10a0fedf', 'volume_name': 'volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c878ba11-a57e-4e82-a222-12f7cf3b74a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c878ba11-a57e-4e82-a222-12f7cf3b74a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08155428-8f48-48c1-92ce-8a50dfb29080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume 7ba07615-74a1-4fcf-bf91-05ff10a0fedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf', 'volume_size': 1}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (00d8852a-0cae-452d-8562-0c5df2c5e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5250d64a-e2db-4341-b4c7-63ba5a6893d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5250d64a-e2db-4341-b4c7-63ba5a6893d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2096753453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe37679-387d-419c-bc5b-a4955f2c2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36eb43c-2b89-402f-985a-c79529a5d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36eb43c-2b89-402f-985a-c79529a5d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72eb2c-742d-4ff6-adcc-8b034e90ef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72eb2c-742d-4ff6-adcc-8b034e90ef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe37679-387d-419c-bc5b-a4955f2c2fc1', 'volume_name': 'volume-abe37679-387d-419c-bc5b-a4955f2c2fc1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168313c-3190-46dd-9744-bb2b0994c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1168313c-3190-46dd-9744-bb2b0994c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4464fcab-421f-44a6-99d6-43fff1f748c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume abe37679-387d-419c-bc5b-a4955f2c2fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe37679-387d-419c-bc5b-a4955f2c2fc1', 'volume_size': 1}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Volume volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea (c8a13a6d-8487-41ad-ba10-440fb27b90ea): created successfully
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9aee38-ec7d-4054-92f9-931f477bd189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (75109c5b-958b-48bb-bc23-cb85cb0b5679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a 1073741824" returned: 0 in 0.918s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:30 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (f758056c-8599-479c-8861-42dd5cda2735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e588b6-2280-4384-9c13-f1fa0ee847b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec00ca5-a5d5-4ee1-b4be-d30a9737acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f6adf2-f7cf-4da7-826a-be087a766fdb', 'volume_name': 'volume-66f6adf2-f7cf-4da7-826a-be087a766fdb', 'volume_size': 1, 'image_id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9924d81beeaeb13ef4ab4d739e7610f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7def11c22ec14105963af9025a22d4a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a70f78432a09584b35c4a21a2ceb3667a9dd655dc66bd091e4eb82f2fdcdbda353ecfc289245d89fc7668b5484bc3f1f6cee716b3e85dcc361e01ee387cea8fa', 'id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'created_at': datetime.datetime(2025, 9, 25, 18, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790722b30>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0dd362-d523-4b39-aef6-ee9983b92b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0dd362-d523-4b39-aef6-ee9983b92b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcba416-ed85-43cc-b307-75910d585396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Volume 66f6adf2-f7cf-4da7-826a-be087a766fdb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f6adf2-f7cf-4da7-826a-be087a766fdb', 'volume_size': 1, 'image_id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9924d81beeaeb13ef4ab4d739e7610f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7def11c22ec14105963af9025a22d4a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a70f78432a09584b35c4a21a2ceb3667a9dd655dc66bd091e4eb82f2fdcdbda353ecfc289245d89fc7668b5484bc3f1f6cee716b3e85dcc361e01ee387cea8fa', 'id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'created_at': datetime.datetime(2025, 9, 25, 18, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790722b30>}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Cloning 66f6adf2-f7cf-4da7-826a-be087a766fdb from image 70ed6cbc-21b0-45f4-a3e5-2755392227e5  at location (None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}]). {{(pid=83952) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e588b6-2280-4384-9c13-f1fa0ee847b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1284115856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d95af29-6b55-421b-a7e5-724b22e0867d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2d71ab-7193-4dcf-bf0a-97201b61e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2d71ab-7193-4dcf-bf0a-97201b61e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e81bea-013d-49e4-9c5e-b493127b18a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e81bea-013d-49e4-9c5e-b493127b18a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d95af29-6b55-421b-a7e5-724b22e0867d', 'volume_name': 'volume-7d95af29-6b55-421b-a7e5-724b22e0867d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25ccd33-886e-463a-96b2-1ed7300f6ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25ccd33-886e-463a-96b2-1ed7300f6ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29091848-9361-4c91-bcca-02c4ed94b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume 7d95af29-6b55-421b-a7e5-724b22e0867d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d95af29-6b55-421b-a7e5-724b22e0867d', 'volume_size': 1}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a" returned: 0 in 0.596s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] <== create_volume: return (1550ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.287s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324713452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2cca2c-5882-40b7-9903-a8616f8d295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:24Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Creating volume cc2cca2c-5882-40b7-9903-a8616f8d295f {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:30 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:30 devstack quobyte-client[83978]: System call of process 100776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:30 devstack quobyte-client[83978]: System call of process 100776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:30 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=150, name=volume-cc2cca2c-5882-40b7-9903-a8616f8d295f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f 1073741824" returned: 0 in 0.344s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f" returned: 0 in 0.078s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.491s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-151305229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89b1056-a47f-4ca7-a6c0-3567ddc01b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c63eb05c834748b106c17be19ab728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:26Z,use_quota=True,user_id='7f8a7821f42748168817a793694ed0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Creating volume a89b1056-a47f-4ca7-a6c0-3567ddc01b5b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:31 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:31 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=151, name=volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b 1073741824" returned: 0 in 0.336s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" returned: 0 in 0.083s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] <== create_volume: return (494ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-284757956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9668e1b-7033-4a66-baba-b0c87648ef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:28Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume b9668e1b-7033-4a66-baba-b0c87648ef35 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:32 devstack quobyte-client[83978]: System call of process 100784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:32 devstack quobyte-client[83978]: System call of process 100784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-907802fc-a927-4ccd-bada-88ccf05380b5 tempest-CreateVolumesFromImageTest-1874382015 None] Created volume successfully.
Sep 25 20:10:32 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=152, name=volume-b9668e1b-7033-4a66-baba-b0c87648ef35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD, size 0.00 MB, duration 1.66 sec {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00e18e2-632d-4095-8a57-841157316c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58b57f-601b-4271-83a2-dd0b8ea2ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accf1dca-4399-4142-9375-cd286e0e6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2cca2c-5882-40b7-9903-a8616f8d295f', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e62a6d8-58ac-49be-b664-e19962971f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab42473f-48c4-4ace-be7c-fcc07a230b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9336efbf-041f-4bd5-b2f2-69f2795a923a', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566f8db8-ede6-47df-8520-abff5b2e0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Volume volume-cc2cca2c-5882-40b7-9903-a8616f8d295f (cc2cca2c-5882-40b7-9903-a8616f8d295f): created successfully
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e62a6d8-58ac-49be-b664-e19962971f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (6c77d927-bd4d-4405-9da1-16719cedfbae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Volume volume-9336efbf-041f-4bd5-b2f2-69f2795a923a (9336efbf-041f-4bd5-b2f2-69f2795a923a): created successfully
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566f8db8-ede6-47df-8520-abff5b2e0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (9811aa2d-0791-4e41-b39b-2c0bfc5a7cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c288a-9165-40e2-9451-47a4aedbd00e]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35 1073741824" returned: 0 in 0.665s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c445de76-d201-4b27-8666-9f0b765ea733 tempest-CreateVolumesFromImageTest-1874382015 None] Created volume successfully.
Sep 25 20:10:33 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Volume volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b (a89b1056-a47f-4ca7-a6c0-3567ddc01b5b): created successfully
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58b57f-601b-4271-83a2-dd0b8ea2ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Flow 'volume_create_manager' (cc4f2328-d8de-414e-a0c2-cc1501362a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:33 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD
Sep 25 20:10:33 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:10:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0aa44926-3028-4ff5-9f08-b1b213f6b362 tempest-CreateVolumesFromImageTest-1874382015 None] Created volume successfully.
Sep 25 20:10:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-86bf17c6-705f-489e-81c9-776ad6ee8070 tempest-CreateVolumesFromImageTest-1874382015 None] Created volume successfully.
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35" returned: 0 in 0.460s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1296ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.494s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-975476997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457f79e7-fe32-4a76-baef-12d62543eec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:28Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume 457f79e7-fe32-4a76-baef-12d62543eec9 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:33 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:33 devstack quobyte-client[83978]: System call of process 100790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:33 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=153, name=volume-457f79e7-fe32-4a76-baef-12d62543eec9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecc020d-a02e-4407-8b0a-dd9e5a2ce1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9668e1b-7033-4a66-baba-b0c87648ef35', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:33 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dbb5c-0460-48cc-aacc-46d6e017ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:34 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-b9668e1b-7033-4a66-baba-b0c87648ef35 (b9668e1b-7033-4a66-baba-b0c87648ef35): created successfully
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dbb5c-0460-48cc-aacc-46d6e017ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (18b63ff9-48bf-4de2-9a66-d08d43e8d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9 1073741824" returned: 0 in 0.680s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b-delete_volume" acquired by "delete_volume" :: waited 0.232s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:34 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-65884d33-af82-4fff-bc7b-490868271e64 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9" returned: 0 in 0.421s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1155ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.569s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2124872802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba07615-74a1-4fcf-bf91-05ff10a0fedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume 7ba07615-74a1-4fcf-bf91-05ff10a0fedf {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:34 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:34 devstack quobyte-client[83978]: System call of process 100794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:34 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=154, name=volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94764f1b-fce4-45f3-b6d2-08e297080e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457f79e7-fe32-4a76-baef-12d62543eec9', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:34 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31251960-af6e-4047-86f7-32e78185ba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-quobyte-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:35 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-457f79e7-fe32-4a76-baef-12d62543eec9 (457f79e7-fe32-4a76-baef-12d62543eec9): created successfully
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31251960-af6e-4047-86f7-32e78185ba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (316bee07-9a14-4055-a781-aeab8296b525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf 1073741824" returned: 0 in 0.689s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" acquired by "delete_volume" :: waited 0.341s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-864575ec-253a-4585-a686-ac05dd23a820 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:35 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b251eaa7-b7ae-45e3-b616-8bd78a2d80b4]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" returned: 0 in 0.656s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 0 in 3.332s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1397ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.097s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:36 devstack quobyte-client[83978]: System call of process 100800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2096753453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe37679-387d-419c-bc5b-a4955f2c2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume abe37679-387d-419c-bc5b-a4955f2c2fc1 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:36 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:36 devstack quobyte-client[83978]: System call of process 100804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:36 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=155, name=volume-abe37679-387d-419c-bc5b-a4955f2c2fc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08155428-8f48-48c1-92ce-8a50dfb29080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633d5914-6a24-477d-933a-bff67f776526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:36 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD
Sep 25 20:10:36 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" returned: 0 in 1.055s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 1073741824" returned: 0 in 0.554s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf (7ba07615-74a1-4fcf-bf91-05ff10a0fedf): created successfully
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633d5914-6a24-477d-933a-bff67f776526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (39d7b3da-07ef-4a87-a173-96f84e2de838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1" returned: 0 in 0.367s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" returned: 0 in 0.522s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1081ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.751s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1284115856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d95af29-6b55-421b-a7e5-724b22e0867d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335d326cc7745c4b87d77fd8cb48ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:29Z,use_quota=True,user_id='518ea87ca02f425f9e95887c668a1618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Creating volume 7d95af29-6b55-421b-a7e5-724b22e0867d {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:37 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:37 devstack quobyte-client[83978]: System call of process 100811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:37 devstack quobyte-client[83978]: System call of process 100811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:37 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=156, name=volume-7d95af29-6b55-421b-a7e5-724b22e0867d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-822e7950-50e4-41c1-a048-b1c8eff1be3f tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b" released by "delete_volume" :: held 2.520s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4464fcab-421f-44a6-99d6-43fff1f748c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe37679-387d-419c-bc5b-a4955f2c2fc1', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbfa33-3184-4f5f-b837-686f1e46be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d 1073741824" returned: 0 in 0.757s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:38 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 (abe37679-387d-419c-bc5b-a4955f2c2fc1): created successfully
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbfa33-3184-4f5f-b837-686f1e46be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:38 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (00d8852a-0cae-452d-8562-0c5df2c5e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d" returned: 0 in 0.727s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c1a2c33b-9278-4fa3-b34c-1a26edbe325e tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] <== create_volume: return (1546ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Created reservations ['cb9eb0da-c22e-4f09-87df-c245ce015963', '9bf8dc85-8ea8-4bfe-a971-46b2700560f5', 'd0a7f68f-e0e6-4786-be87-8eeb69b546b5', 'e639b9b6-714c-4601-a6ea-e19435df9ef1'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29091848-9361-4c91-bcca-02c4ed94b418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d95af29-6b55-421b-a7e5-724b22e0867d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639a25ae-baaf-4eba-a753-354741b1816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume volume-7d95af29-6b55-421b-a7e5-724b22e0867d (7d95af29-6b55-421b-a7e5-724b22e0867d): created successfully
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639a25ae-baaf-4eba-a753-354741b1816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Flow 'volume_create_manager' (f758056c-8599-479c-8861-42dd5cda2735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-35c44ba8-2590-4056-8a60-d40ec1fb50c9 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created volume successfully.
Sep 25 20:10:39 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 1 in 3.184s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Temporary image 70ed6cbc-21b0-45f4-a3e5-2755392227e5 is fetched for user 773586f2e69b454caec56b4416d6faa3. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.310s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Deleted volume successfully.
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72c611a-2c34-4950-b059-b4810431206d]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-179f9379-d499-4e40-9342-e787972f0411 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-a89b1056-a47f-4ca7-a6c0-3567ddc01b5b-delete_volume" released by "delete_volume" :: held 5.724s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-7d95af29-6b55-421b-a7e5-724b22e0867d-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-7d95af29-6b55-421b-a7e5-724b22e0867d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:40 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD
Sep 25 20:10:40 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-c8a13a6d-8487-41ad-ba10-440fb27b90ea-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-c8a13a6d-8487-41ad-ba10-440fb27b90ea-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:40 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-7d95af29-6b55-421b-a7e5-724b22e0867d" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-7d95af29-6b55-421b-a7e5-724b22e0867d" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d72d7-c2b1-4476-9cda-6f7b88571feb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:40 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-quobyte-c8a13a6d-8487-41ad-ba10-440fb27b90ea" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-c8a13a6d-8487-41ad-ba10-440fb27b90ea" acquired by "delete_volume" :: waited 0.091s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d7a0dc-3d79-4d2b-af33-95de6bcf6ceb]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:41 devstack quobyte-client[83978]: System call of process 100821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d" returned: 0 in 0.805s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7d95af29-6b55-421b-a7e5-724b22e0867d" returned: 0 in 0.165s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-7d95af29-6b55-421b-a7e5-724b22e0867d" released by "delete_volume" :: held 1.230s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:41 devstack quobyte-client[83978]: System call of process 100822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:41 devstack quobyte-client[83978]: System call of process 100822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea" returned: 0 in 0.990s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c8a13a6d-8487-41ad-ba10-440fb27b90ea" returned: 0 in 0.436s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-c8a13a6d-8487-41ad-ba10-440fb27b90ea" released by "delete_volume" :: held 1.591s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:42 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['008aadd2-3500-4a8f-8c38-f1ac30f3d63e', '877c1f61-4ed2-4012-b6a2-cd1af20fc9bb', 'ba533f12-d707-4fe8-a84c-7e20f347f51b', 'e4613bee-bea7-4294-86d1-581656a97f24'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 0 in 3.054s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:43 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD
Sep 25 20:10:43 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.216s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:43 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-abe37679-387d-419c-bc5b-a4955f2c2fc1-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:43 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Created reservations ['c5747a9c-1a08-4867-b3f2-7c91c6061d6b', '46a6330d-f10e-4bba-9763-e0807605abb7', 'a9a305cc-1cd3-4ded-853e-4a5d1437ee97', '660cfb63-67f7-4c3f-91ca-f9a81156524a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-85492ab8-8e26-46c8-9179-fad744727171 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-7d95af29-6b55-421b-a7e5-724b22e0867d-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-abe37679-387d-419c-bc5b-a4955f2c2fc1-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-abe37679-387d-419c-bc5b-a4955f2c2fc1" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-abe37679-387d-419c-bc5b-a4955f2c2fc1" acquired by "delete_volume" :: waited 0.030s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42fbe39-f33e-40c8-a8ab-6d1222e382a1]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.254s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Deleted volume successfully.
Sep 25 20:10:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-20235b81-3214-4d89-91e1-82ab1228bc51 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-c8a13a6d-8487-41ad-ba10-440fb27b90ea-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:45 devstack quobyte-client[83978]: System call of process 100835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:45 devstack quobyte-client[83978]: System call of process 100835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:45 devstack quobyte-client[83978]: System call of process 100835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-9336efbf-041f-4bd5-b2f2-69f2795a923a-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1" returned: 0 in 0.879s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-9336efbf-041f-4bd5-b2f2-69f2795a923a-delete_volume" acquired by "delete_volume" :: waited 0.258s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:45 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 1 in 2.938s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f6adf2-f7cf-4da7-826a-be087a766fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def11c22ec14105963af9025a22d4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:10:27Z,use_quota=True,user_id='773586f2e69b454caec56b4416d6faa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Creating volume 66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:10:45 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-abe37679-387d-419c-bc5b-a4955f2c2fc1" returned: 0 in 0.648s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:46 devstack quobyte-client[83978]: System call of process 100842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:46 devstack quobyte-client[83978]: System call of process 100842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:46 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=157, name=volume-66f6adf2-f7cf-4da7-826a-be087a766fdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-abe37679-387d-419c-bc5b-a4955f2c2fc1" released by "delete_volume" :: held 2.060s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:46 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-quobyte-9336efbf-041f-4bd5-b2f2-69f2795a923a" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb 1073741824" returned: 0 in 0.527s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 0 in 0.347s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-9336efbf-041f-4bd5-b2f2-69f2795a923a" acquired by "delete_volume" :: waited 0.380s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a4995-542e-47b2-a822-2b13eabbfe33]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['7f60fb01-b93e-4061-8c19-7d1a9518fb5c', '752497ef-23e9-44ae-9ea8-47b25678c053', 'd5116c42-66a8-4f4a-b8bd-e19fdfc35782', 'a06afcbf-caf4-4dd6-81f4-b15297574d1e'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Attempting download of 70ed6cbc-21b0-45f4-a3e5-2755392227e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}])) to volume 66f6adf2-f7cf-4da7-826a-be087a766fdb. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56a236-e985-4ed1-8b44-9a97dd819e04]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_70ed6cbc-21b0-45f4-a3e5-2755392227e5_5xd0eyb2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a" returned: 0 in 0.962s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.201s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:48 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_70ed6cbc-21b0-45f4-a3e5-2755392227e5_5xd0eyb2" returned: 0 in 0.784s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-9336efbf-041f-4bd5-b2f2-69f2795a923a" returned: 0 in 0.342s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ed6cbc-21b0-45f4-a3e5-2755392227e5_5xd0eyb2 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-95641b67-d2bd-4f23-846f-9cc02f7f43b1 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-abe37679-387d-419c-bc5b-a4955f2c2fc1-delete_volume" released by "delete_volume" :: held 4.489s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-7ba07615-74a1-4fcf-bf91-05ff10a0fedf-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-9336efbf-041f-4bd5-b2f2-69f2795a923a" released by "delete_volume" :: held 1.881s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ed6cbc-21b0-45f4-a3e5-2755392227e5_5xd0eyb2" returned: 1 in 0.558s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_70ed6cbc-21b0-45f4-a3e5-2755392227e5_5xd0eyb2' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-7ba07615-74a1-4fcf-bf91-05ff10a0fedf-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1c1384-7849-41ff-9d87-044d5e91f57f]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:48 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:49 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Created reservations ['26166131-bfbb-466b-b96f-630cba13830b', 'e14fcccd-4822-4c73-a54c-63a2c4bbe61d', '6f570e3b-871f-44d7-8aca-2d64efd33cd8', '52226de8-31cc-4d5b-bf48-5028b93de841'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" acquired by "delete_volume" :: waited 0.071s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a3a49-ce2d-468b-8384-7718bcc66038]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 0 in 0.646s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:49 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:49 devstack quobyte-client[83978]: System call of process 100860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" returned: 0 in 0.711s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" returned: 0 in 0.303s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD" returned: 1 in 0.879s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] 70ed6cbc-21b0-45f4-a3e5-2755392227e5 was raw, converting to raw {{(pid=83952) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-7ba07615-74a1-4fcf-bf91-05ff10a0fedf" released by "delete_volume" :: held 1.335s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:50 devstack quobyte-client[83978]: System call of process 100871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:50 devstack quobyte-client[83978]: System call of process 100871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:50 devstack quobyte-client[83978]: System call of process 100871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:50 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=157, name=volume-66f6adf2-f7cf-4da7-826a-be087a766fdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.573s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:50 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-cc2cca2c-5882-40b7-9903-a8616f8d295f-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:51 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Deleted volume successfully.
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 0 in 0.532s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_70ed6cbc-21b0-45f4-a3e5-2755392227e5_l5d0ehtkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:10:51 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-cc2cca2c-5882-40b7-9903-a8616f8d295f-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-978cc29c-cb02-49ad-831f-7389fdfd16da tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-9336efbf-041f-4bd5-b2f2-69f2795a923a-delete_volume" released by "delete_volume" :: held 6.064s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb 1G" returned: 0 in 0.445s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['145898f9-d79d-45a8-8ca4-50e5b8d6646e', 'db20521c-2267-454c-ab14-39eabbcba805', '7c0ecb0f-c17e-49ee-8dc0-e62c1eea2e5c', 'febb66da-94af-4597-9668-492d70ad4fac'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed434b17-5236-4422-8dbe-f920c407d5f9]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:51 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:52 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-quobyte-cc2cca2c-5882-40b7-9903-a8616f8d295f" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-cc2cca2c-5882-40b7-9903-a8616f8d295f" acquired by "delete_volume" :: waited 0.100s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f26d93c-1469-4387-bac6-5da11d956d8f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 0 in 0.790s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:52 devstack quobyte-client[83978]: System call of process 100882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:52 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-457f79e7-fe32-4a76-baef-12d62543eec9-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f" returned: 0 in 0.949s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.561s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 1 in 0.961s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-457f79e7-fe32-4a76-baef-12d62543eec9-delete_volume" acquired by "delete_volume" :: waited 0.347s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Downloaded image 70ed6cbc-21b0-45f4-a3e5-2755392227e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}])) to volume 66f6adf2-f7cf-4da7-826a-be087a766fdb successfully. {{(pid=83952) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Temporary image 70ed6cbc-21b0-45f4-a3e5-2755392227e5 for user 773586f2e69b454caec56b4416d6faa3 is deleted. {{(pid=83952) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.volume.volume_utils [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Marking volume 66f6adf2-f7cf-4da7-826a-be087a766fdb as bootable. {{(pid=83952) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 25 20:10:53 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-cc2cca2c-5882-40b7-9903-a8616f8d295f" returned: 0 in 0.418s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-cc2cca2c-5882-40b7-9903-a8616f8d295f" released by "delete_volume" :: held 1.490s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Copying metadata from image 70ed6cbc-21b0-45f4-a3e5-2755392227e5 to 66f6adf2-f7cf-4da7-826a-be087a766fdb. {{(pid=83952) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Creating volume glance metadata for volume 66f6adf2-f7cf-4da7-826a-be087a766fdb backed by image 70ed6cbc-21b0-45f4-a3e5-2755392227e5 with: {'image_id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9924d81beeaeb13ef4ab4d739e7610f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83952) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 20:10:53 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-457f79e7-fe32-4a76-baef-12d62543eec9" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f526bb72-28da-46f5-8c4e-e8fdd59b7053 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-7ba07615-74a1-4fcf-bf91-05ff10a0fedf-delete_volume" released by "delete_volume" :: held 4.986s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-457f79e7-fe32-4a76-baef-12d62543eec9" acquired by "delete_volume" :: waited 0.046s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837acd3-c112-46c0-bb16-b0b8e8c3fce6]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Created reservations ['f76d1aba-89bf-4c39-a9eb-8e5a371e4dbf', 'bdd66d05-7874-4619-b68b-8046164a257e', '8eb4a475-96ff-4032-8e57-9dc3af96f75d', 'ea14e488-bd85-497d-8220-520ca3d9ca40'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcba416-ed85-43cc-b307-75910d585396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f6adf2-f7cf-4da7-826a-be087a766fdb', 'volume_size': 1, 'image_id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9924d81beeaeb13ef4ab4d739e7610f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7def11c22ec14105963af9025a22d4a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a70f78432a09584b35c4a21a2ceb3667a9dd655dc66bd091e4eb82f2fdcdbda353ecfc289245d89fc7668b5484bc3f1f6cee716b3e85dcc361e01ee387cea8fa', 'id': '70ed6cbc-21b0-45f4-a3e5-2755392227e5', 'created_at': datetime.datetime(2025, 9, 25, 18, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 25, 18, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/70ed6cbc-21b0-45f4-a3e5-2755392227e5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9790722b30>}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596a955-5d18-4de7-8ec7-91a5bb1dba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:10:54 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Volume volume-66f6adf2-f7cf-4da7-826a-be087a766fdb (66f6adf2-f7cf-4da7-826a-be087a766fdb): created successfully
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596a955-5d18-4de7-8ec7-91a5bb1dba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Flow 'volume_create_manager' (118a2d34-8554-457a-98d7-2fc15dfb9637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:10:54 devstack quobyte-client[83978]: System call of process 100890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:54 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-87e51fc8-20c6-45f3-9fbf-057a2e74a012 tempest-VolumeImageDependencyTests-1127377756 None] Created volume successfully.
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9" returned: 0 in 0.637s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-457f79e7-fe32-4a76-baef-12d62543eec9" returned: 0 in 0.233s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-457f79e7-fe32-4a76-baef-12d62543eec9" released by "delete_volume" :: held 0.995s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.491s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Acquiring lock "cinder-66f6adf2-f7cf-4da7-826a-be087a766fdb-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.455s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-55d45d1a-9f37-40c6-b265-4a2707662b84-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Deleted volume successfully.
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['30747766-3243-402c-bb9d-bfe21ca65775', '6b5d7d76-9a54-4e7e-b623-1d0f1af88c11', '4bf14407-567f-4803-873b-f46214400e3f', '5162ee90-ad95-436b-9a0b-ecf9cfe76798'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "cinder-66f6adf2-f7cf-4da7-826a-be087a766fdb-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-55d45d1a-9f37-40c6-b265-4a2707662b84-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-771f2b67-9f92-4a22-a54b-98935bae8acb tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-cc2cca2c-5882-40b7-9903-a8616f8d295f-delete_volume" released by "delete_volume" :: held 4.387s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Acquiring lock "cinder-quobyte-66f6adf2-f7cf-4da7-826a-be087a766fdb" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "cinder-quobyte-55d45d1a-9f37-40c6-b265-4a2707662b84" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "cinder-quobyte-66f6adf2-f7cf-4da7-826a-be087a766fdb" acquired by "delete_volume" :: waited 0.034s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-55d45d1a-9f37-40c6-b265-4a2707662b84" acquired by "delete_volume" :: waited 0.053s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89858e4-7a17-4adc-9564-cd7c4f8dc298]: (4, 'raw') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f92dde-277a-4a88-be94-3567199de2e5]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:56 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-b9668e1b-7033-4a66-baba-b0c87648ef35-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:56 devstack quobyte-client[83978]: System call of process 100896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:56 devstack quobyte-client[83978]: System call of process 100896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.789s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:10:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 0 in 1.208s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-b9668e1b-7033-4a66-baba-b0c87648ef35-delete_volume" acquired by "delete_volume" :: waited 0.500s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84" returned: 0 in 1.371s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-2803760e-550b-4da4-a2be-45259bddd292 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-457f79e7-fe32-4a76-baef-12d62543eec9-delete_volume" released by "delete_volume" :: held 4.381s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-b9668e1b-7033-4a66-baba-b0c87648ef35" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-55d45d1a-9f37-40c6-b265-4a2707662b84" returned: 0 in 0.484s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 1 in 0.978s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb' failed. Not Retrying. {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-quobyte-55d45d1a-9f37-40c6-b265-4a2707662b84" released by "delete_volume" :: held 2.377s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-b9668e1b-7033-4a66-baba-b0c87648ef35" acquired by "delete_volume" :: waited 0.366s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-66f6adf2-f7cf-4da7-826a-be087a766fdb" returned: 0 in 0.359s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6940f31-e53c-4edd-bf60-3dc5933fbba3]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "cinder-quobyte-66f6adf2-f7cf-4da7-826a-be087a766fdb" released by "delete_volume" :: held 2.937s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Created reservations ['6f0e3226-e7bf-4a75-b10a-2b17424d0e6d', 'c3f847ce-f955-405d-b191-0923097ad2ac', 'a0d46c41-32aa-4ba9-b652-a043da7fef31', 'cd58cdc7-273b-4153-96ce-d6a46281054f'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:59 devstack quobyte-client[83978]: System call of process 100909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Created reservations ['d97e4f99-fbb3-4e83-93bf-c0f765d86d2a', 'c8177610-955a-4847-b5b3-40769f2cfc43', '06222422-a644-4c2d-a145-bfe1086549f2', 'de243a85-1bb8-4b7f-8383-029651143ad4'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35" returned: 0 in 0.658s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-b9668e1b-7033-4a66-baba-b0c87648ef35" returned: 0 in 0.322s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-b9668e1b-7033-4a66-baba-b0c87648ef35" released by "delete_volume" :: held 1.147s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:10:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.529s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.385s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Deleted volume successfully.
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4c6f819-4f3b-4ddf-977b-d20668397423 tempest-CreateVolumesFromImageTest-1874382015 None] Lock "cinder-55d45d1a-9f37-40c6-b265-4a2707662b84-delete_volume" released by "delete_volume" :: held 4.702s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['327bb605-daa3-4dbd-9723-c19053dbe10e', '387e7006-d9cd-4bad-8f00-648f4be2a423', 'fbf14c25-b412-405a-a772-94754a4c8796', '7c03eb2b-4628-49b4-b243-000374abc32f'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Deleted volume successfully.
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-f974aa58-26e2-418e-a37b-d04d6eb978a8 tempest-VolumeImageDependencyTests-1127377756 None] Lock "cinder-66f6adf2-f7cf-4da7-826a-be087a766fdb-delete_volume" released by "delete_volume" :: held 4.834s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.117s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:00 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:00 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:11:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-e4703019-d672-462b-9822-57a5aeb2fc30 tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-b9668e1b-7033-4a66-baba-b0c87648ef35-delete_volume" released by "delete_volume" :: held 3.715s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-28b46b84-add1-4cbf-b1e6-99e3a4747971-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-28b46b84-add1-4cbf-b1e6-99e3a4747971-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:02 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "cinder-quobyte-28b46b84-add1-4cbf-b1e6-99e3a4747971" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-28b46b84-add1-4cbf-b1e6-99e3a4747971" acquired by "delete_volume" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac1eaf-aac0-4362-8b37-097f620b9bd0]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971" returned: 0 in 0.658s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:02 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-28b46b84-add1-4cbf-b1e6-99e3a4747971" returned: 0 in 0.145s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-quobyte-28b46b84-add1-4cbf-b1e6-99e3a4747971" released by "delete_volume" :: held 1.019s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Created reservations ['04ee40bc-b68e-4a1c-b006-137423af8990', 'e0791c3d-929c-42d7-acf9-7baa2c655ce1', '8968e187-44ca-42f6-b6fb-038aea984e8b', 'cdddec61-31ee-4d44-8870-03ef5d1af526'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.138s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:03 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:03 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Deleted volume successfully.
Sep 25 20:11:04 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-d9b144cb-3cf1-40ab-ad5e-79002c6a0e6b tempest-CreateVolumesFromSourceVolumeTest-745980725 None] Lock "cinder-28b46b84-add1-4cbf-b1e6-99e3a4747971-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:05 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Flow 'volume_create_manager' (fa73d1be-3806-43e1-a7f4-a7d5ecbf108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3251b27-ed53-4453-b846-73bd7bfac376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3251b27-ed53-4453-b846-73bd7bfac376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816bba19-1f02-42a3-84dc-34287d83f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a662ceb26194639a9925ed0c158c6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:05Z,use_quota=True,user_id='d711b9d9e73d433cab7e74852d59c74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbb93d5-b4c9-4a8e-8a20-9e54506218de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbb93d5-b4c9-4a8e-8a20-9e54506218de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4bffe0-4513-4c71-8d0a-a1ab9b1e1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4bffe0-4513-4c71-8d0a-a1ab9b1e1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816bba19-1f02-42a3-84dc-34287d83f05b', 'volume_name': 'volume-816bba19-1f02-42a3-84dc-34287d83f05b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ba2dc5-cfc3-4afe-8c38-ebcba45adf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ba2dc5-cfc3-4afe-8c38-ebcba45adf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d8119b-c873-48ea-9bbb-a4d59f1b1e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:05 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Volume 816bba19-1f02-42a3-84dc-34287d83f05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816bba19-1f02-42a3-84dc-34287d83f05b', 'volume_size': 1}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816bba19-1f02-42a3-84dc-34287d83f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a662ceb26194639a9925ed0c158c6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:05Z,use_quota=True,user_id='d711b9d9e73d433cab7e74852d59c74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Creating volume 816bba19-1f02-42a3-84dc-34287d83f05b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:05 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:05 devstack quobyte-client[83978]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:05 devstack quobyte-client[83978]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:05 devstack quobyte-client[83978]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:05 devstack quobyte-client[83978]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:05 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=158, name=volume-816bba19-1f02-42a3-84dc-34287d83f05b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b 1073741824" returned: 0 in 0.467s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:05 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:06 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (d602d9d1-ccde-4605-b77f-148c700f523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51edc73-5c1a-43f8-8ad0-e50dbf43ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b" returned: 0 in 0.541s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51edc73-5c1a-43f8-8ad0-e50dbf43ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-119626144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4ce886-15e3-49f1-a8dc-76274d223ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:05Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41e97b2-2f9d-438c-a06d-dc6b9c88a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41e97b2-2f9d-438c-a06d-dc6b9c88a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b9b82a-2424-4cee-b443-26a6766bff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b9b82a-2424-4cee-b443-26a6766bff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4ce886-15e3-49f1-a8dc-76274d223ceb', 'volume_name': 'volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0905872e-6cce-4ead-add4-4dad5c583429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0905872e-6cce-4ead-add4-4dad5c583429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cb2111-bf2d-4b78-8e26-bb8df43bce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume 7e4ce886-15e3-49f1-a8dc-76274d223ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb', 'volume_size': 1}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] <== create_volume: return (1096ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-119626144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4ce886-15e3-49f1-a8dc-76274d223ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:05Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume 7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:06 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack quobyte-client[83978]: System call of process 100959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d8119b-c873-48ea-9bbb-a4d59f1b1e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816bba19-1f02-42a3-84dc-34287d83f05b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=159, name=volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44082f2a-5575-4149-b0e2-7a5a92afdd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:06 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Volume volume-816bba19-1f02-42a3-84dc-34287d83f05b (816bba19-1f02-42a3-84dc-34287d83f05b): created successfully
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44082f2a-5575-4149-b0e2-7a5a92afdd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Flow 'volume_create_manager' (fa73d1be-3806-43e1-a7f4-a7d5ecbf108a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb 1073741824" returned: 0 in 0.477s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:06 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:07 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-180af704-407a-405c-82d5-efadd20b9333 tempest-CinderUnicodeTest-764299876 None] Created volume successfully.
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb" returned: 0 in 0.377s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cb2111-bf2d-4b78-8e26-bb8df43bce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67a6d7-8ae7-41d5-bb16-4bb5e2aaca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb (7e4ce886-15e3-49f1-a8dc-76274d223ceb): created successfully
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67a6d7-8ae7-41d5-bb16-4bb5e2aaca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (d602d9d1-ccde-4605-b77f-148c700f523b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:07 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-086b6aa8-68cd-4f86-a0cb-a66708b6c74e tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:07 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Flow 'volume_create_manager' (e5e02d46-8b59-4b58-828f-7cf7b7d24f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01138bc3-ba41-435d-a630-f797f367344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01138bc3-ba41-435d-a630-f797f367344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-719040266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511ac2d-8d28-46d0-b4a9-b2b790ac85aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a662ceb26194639a9925ed0c158c6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:08Z,use_quota=True,user_id='d711b9d9e73d433cab7e74852d59c74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dc5dcb-ff6b-4ec5-9cce-a2ea02977b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dc5dcb-ff6b-4ec5-9cce-a2ea02977b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb87db0f-ea1a-4865-927f-221f960af72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb87db0f-ea1a-4865-927f-221f960af72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c511ac2d-8d28-46d0-b4a9-b2b790ac85aa', 'volume_name': 'volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ebf4f8-eb0e-48b4-9a1b-1350301aeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ebf4f8-eb0e-48b4-9a1b-1350301aeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7ad3c-7837-407c-b5e9-913158b06507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:07 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Volume c511ac2d-8d28-46d0-b4a9-b2b790ac85aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa', 'volume_size': 1}
Sep 25 20:11:07 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-719040266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511ac2d-8d28-46d0-b4a9-b2b790ac85aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a662ceb26194639a9925ed0c158c6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:08Z,use_quota=True,user_id='d711b9d9e73d433cab7e74852d59c74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Creating volume c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:08 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:08 devstack quobyte-client[83978]: System call of process 100964 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:08 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=160, name=volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa 1073741824" returned: 0 in 0.382s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7ad3c-7837-407c-b5e9-913158b06507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:08 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa937441-fbc7-49ad-bd0d-a95fac054613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:09 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Volume volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa (c511ac2d-8d28-46d0-b4a9-b2b790ac85aa): created successfully
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa937441-fbc7-49ad-bd0d-a95fac054613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Flow 'volume_create_manager' (e5e02d46-8b59-4b58-828f-7cf7b7d24f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:09 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-2792281c-0de4-41cd-8ec1-d79c2108e912 tempest-CinderUnicodeTest-764299876 None] Created volume successfully.
Sep 25 20:11:09 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating offline snapshot a76fff17-ad03-49ec-afb2-d53e984faa5a of volume 7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8134b-9ae6-4ab5-a408-bbaffe50b5b8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:09 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:09 devstack quobyte-client[83978]: System call of process 100968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb" returned: 0 in 0.528s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:10 devstack quobyte-client[83978]: System call of process 100971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:10 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=161, name=volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a 1G" returned: 0 in 0.571s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:10 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img rebase -u -b volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.314s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:10 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.108s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.125s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.info" returned: 0 in 0.145s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.info" returned: 0 in 0.104s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.809s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Creating offline snapshot 5cf193ae-9347-4197-bc18-b9bb487a4092 of volume c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:11:11 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[b239676a-12fd-466e-af98-a5c9474e72e5]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:12 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-b8d82fed-7258-469f-9115-5fb66cb65649 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Create snapshot completed successfully
Sep 25 20:11:12 devstack quobyte-client[83978]: System call of process 100981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" returned: 0 in 0.638s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:12 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:12 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=163, name=volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 1G" returned: 0 in 0.347s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:13 devstack quobyte-client[83978]: System call of process 100987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:13 devstack quobyte-client[83978]: System call of process 100987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "qemu-img rebase -u -b volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 0.489s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:13 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:13 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (ef2a4076-d9a2-41a4-ab82-259e3943bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb79056-3a3d-4d08-93b4-c01d3bbcd64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 0.847s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb79056-3a3d-4d08-93b4-c01d3bbcd64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241640321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503dfc6c-e90b-4e45-9994-93fee78950f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:13Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234403a6-2779-49fc-b01c-a89f2ca6f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234403a6-2779-49fc-b01c-a89f2ca6f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d5235-955d-4686-b82a-129dd7168606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d5235-955d-4686-b82a-129dd7168606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503dfc6c-e90b-4e45-9994-93fee78950f7', 'volume_name': 'volume-503dfc6c-e90b-4e45-9994-93fee78950f7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ff8f34-34f3-4605-8268-06fcbeff814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ff8f34-34f3-4605-8268-06fcbeff814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de95da62-6da7-45c8-ab31-6f6cd0a8a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:14 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume 503dfc6c-e90b-4e45-9994-93fee78950f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503dfc6c-e90b-4e45-9994-93fee78950f7', 'volume_size': 1}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:14 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:14 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (6aea2bd8-db6e-4a5b-85a4-16d1aa112ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77320d0b-b49f-41a5-b137-57c1e77bc575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 0.996s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:15 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (0b8dbb7f-e4e8-4b15-a3c3-0cb66022e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:15 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1641a-7c7a-4471-9ef5-83d49c2958a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77320d0b-b49f-41a5-b137-57c1e77bc575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909616835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4b5d2c-987b-45c0-97f2-46d768acf01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:14Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9db60e-65e6-45b9-8e62-c60751fddf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9db60e-65e6-45b9-8e62-c60751fddf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d252e-6b0f-4d13-b48c-801758bc9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d252e-6b0f-4d13-b48c-801758bc9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4b5d2c-987b-45c0-97f2-46d768acf01d', 'volume_name': 'volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db432d92-7088-4f58-aedc-0700ce7ddb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db432d92-7088-4f58-aedc-0700ce7ddb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0552cc27-3899-4a8d-98aa-36ba4a6b2976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume 8b4b5d2c-987b-45c0-97f2-46d768acf01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d', 'volume_size': 1}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1641a-7c7a-4471-9ef5-83d49c2958a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8997787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:14Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725fbf8a-e222-449e-8890-80677fe65cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725fbf8a-e222-449e-8890-80677fe65cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9836abb9-e5ca-4abf-b82c-288cefc5cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9836abb9-e5ca-4abf-b82c-288cefc5cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b', 'volume_name': 'volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3c6228-28c2-442f-9a59-3678c1abdae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3c6228-28c2-442f-9a59-3678c1abdae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f37d4c-d453-4d00-8b24-b8a1bb3b7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b', 'volume_size': 1}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.info" returned: 0 in 0.798s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (7b903ed9-951e-417c-8db4-23b108612ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bd98d5-3add-42e3-bda6-7c2b09ff8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:16 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (bd434236-59db-4b45-a540-ba87ff6082eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:16 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be706d5-b5cb-4c6b-90fb-a119447a25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be706d5-b5cb-4c6b-90fb-a119447a25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552500057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec3cac4-4079-416c-a058-77febbb6a04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:16Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966b115c-75bc-45bb-9c1a-d2defb9688c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966b115c-75bc-45bb-9c1a-d2defb9688c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b3720d-0364-4db7-af30-a36cacdc72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b3720d-0364-4db7-af30-a36cacdc72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec3cac4-4079-416c-a058-77febbb6a04d', 'volume_name': 'volume-7ec3cac4-4079-416c-a058-77febbb6a04d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923331b8-1bde-41ae-90e2-13320006788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923331b8-1bde-41ae-90e2-13320006788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7241be-914e-4159-a7fd-71ebee31fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume 7ec3cac4-4079-416c-a058-77febbb6a04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec3cac4-4079-416c-a058-77febbb6a04d', 'volume_size': 1}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bd98d5-3add-42e3-bda6-7c2b09ff8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411002340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d370e1a-1b8f-410e-a186-f4cc93c1dfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:15Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c489cec-8951-4536-857f-6435d645c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c489cec-8951-4536-857f-6435d645c895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45eec01f-3143-4f61-8d24-acf515a52143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45eec01f-3143-4f61-8d24-acf515a52143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d370e1a-1b8f-410e-a186-f4cc93c1dfef', 'volume_name': 'volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881d72b8-5d12-4707-bb2f-c763e6359bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881d72b8-5d12-4707-bb2f-c763e6359bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c13bbe-1f61-4184-9b2d-72785d8046a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:17 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume 5d370e1a-1b8f-410e-a186-f4cc93c1dfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef', 'volume_size': 1}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.info" returned: 0 in 0.847s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.766s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241640321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503dfc6c-e90b-4e45-9994-93fee78950f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:13Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume 503dfc6c-e90b-4e45-9994-93fee78950f7 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:17 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:17 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=165, name=volume-503dfc6c-e90b-4e45-9994-93fee78950f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:17 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-519ef7c5-b38d-4532-bdad-bcdd0349ee29 tempest-CinderUnicodeTest-764299876 None] Create snapshot completed successfully
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7 1073741824" returned: 0 in 0.635s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:17 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7" returned: 0 in 0.235s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (925ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909616835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4b5d2c-987b-45c0-97f2-46d768acf01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:14Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume 8b4b5d2c-987b-45c0-97f2-46d768acf01d {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:18 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:18 devstack quobyte-client[83978]: System call of process 100999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:18 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=166, name=volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de95da62-6da7-45c8-ab31-6f6cd0a8a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503dfc6c-e90b-4e45-9994-93fee78950f7', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd84b1f-5de8-45fb-9deb-656f5703e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:18 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-503dfc6c-e90b-4e45-9994-93fee78950f7 (503dfc6c-e90b-4e45-9994-93fee78950f7): created successfully
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd84b1f-5de8-45fb-9deb-656f5703e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (ef2a4076-d9a2-41a4-ab82-259e3943bed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d 1073741824" returned: 0 in 0.578s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:18 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-5cf193ae-9347-4197-bc18-b9bb487a4092-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:19 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5231ec76-c522-447f-8a11-99f42fbe8be7 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d" returned: 0 in 0.624s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (1247ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-5cf193ae-9347-4197-bc18-b9bb487a4092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.305s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:19 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8997787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:14Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:19 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:19 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:19 devstack quobyte-client[83978]: System call of process 101003 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:19 devstack quobyte-client[83978]: System call of process 101003 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:19 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=167, name=volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0552cc27-3899-4a8d-98aa-36ba4a6b2976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2148dd72-0b67-4841-8107-fb621d8b6b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b 1073741824" returned: 0 in 0.761s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" acquired by "delete_snapshot" :: waited 0.801s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-quobyte-5cf193ae-9347-4197-bc18-b9bb487a4092" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:20 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d (8b4b5d2c-987b-45c0-97f2-46d768acf01d): created successfully
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2148dd72-0b67-4841-8107-fb621d8b6b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (6aea2bd8-db6e-4a5b-85a4-16d1aa112ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" returned: 0 in 0.417s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (1228ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-5cf193ae-9347-4197-bc18-b9bb487a4092" acquired by "_delete_snapshot" :: waited 0.442s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Deleting offline snapshot 5cf193ae-9347-4197-bc18-b9bb487a4092 of volume c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] snapshot_file for this snap is: volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.819s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552500057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec3cac4-4079-416c-a058-77febbb6a04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:16Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume 7ec3cac4-4079-416c-a058-77febbb6a04d {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:20 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:20 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:21 devstack quobyte-client[83978]: System call of process 101007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:21 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=168, name=volume-7ec3cac4-4079-416c-a058-77febbb6a04d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[17036efb-fb6b-4aef-b005-f92975fc180f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:21 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0ed42f7a-6f4c-4f7b-966e-44532bd8bce0 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=116,cinder:SELECT=82,cinder:DELETE=18,cinder:INSERT=24 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f37d4c-d453-4d00-8b24-b8a1bb3b7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e4e097-2cce-4677-b42b-f12a9cfe74fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:SELECT=95,cinder:UPDATE=156,cinder:DELETE=13,cinder:INSERT=33 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d 1073741824" returned: 0 in 0.983s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:21 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:22 devstack quobyte-client[83978]: System call of process 101010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:22 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b (fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b): created successfully
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e4e097-2cce-4677-b42b-f12a9cfe74fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (0b8dbb7f-e4e8-4b15-a3c3-0cb66022e995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d" returned: 0 in 0.383s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 1.001s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (1397ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.273s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411002340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d370e1a-1b8f-410e-a186-f4cc93c1dfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e3c1875cf344b0a1a2e2197acbbe6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:15Z,use_quota=True,user_id='60bde9ba9dbc4440845c3f699f20dc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Creating volume 5d370e1a-1b8f-410e-a186-f4cc93c1dfef {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:22 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:22 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-355b5cf0-c3f1-4e6f-b802-242986c31326 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:22 devstack quobyte-client[83978]: System call of process 101014 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:22 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=169, name=volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c48d29-ec80-4011-ab40-83559f648ada]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:22 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7241be-914e-4159-a7fd-71ebee31fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec3cac4-4079-416c-a058-77febbb6a04d', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f16a28-01e8-43ae-91cc-350584c244a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef 1073741824" returned: 0 in 0.860s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:23 devstack quobyte-client[83978]: System call of process 101017 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:23 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-7ec3cac4-4079-416c-a058-77febbb6a04d (7ec3cac4-4079-416c-a058-77febbb6a04d): created successfully
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f16a28-01e8-43ae-91cc-350584c244a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:23 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (bd434236-59db-4b45-a540-ba87ff6082eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-30c718bf-e361-4d6f-a04c-4729e0bf189d tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" returned: 0 in 0.663s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] <== create_volume: return (1551ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" returned: 0 in 1.173s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c13bbe-1f61-4184-9b2d-72785d8046a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a87a2e8-7cee-485f-916f-8258345121e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 0.498s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:24 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef (5d370e1a-1b8f-410e-a186-f4cc93c1dfef): created successfully
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a87a2e8-7cee-485f-916f-8258345121e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Flow 'volume_create_manager' (7b903ed9-951e-417c-8db4-23b108612ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:24 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa.5cf193ae-9347-4197-bc18-b9bb487a4092" returned: 0 in 0.349s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:24 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-c466342f-b6a0-4040-a19f-d5c8f0a11960 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created volume successfully.
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-5cf193ae-9347-4197-bc18-b9bb487a4092" released by "_delete_snapshot" :: held 4.073s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" released by "delete_snapshot" :: held 4.540s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Created reservations ['535cc8de-22de-4faa-9752-93bf5434a1f7', '94676627-82da-4e7c-b428-2ace6572389c', 'aa5694c9-62c3-4d47-b180-2a3896790b88', '7904d476-a760-4a34-8458-a4070a0e44bd'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-7ec3cac4-4079-416c-a058-77febbb6a04d-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-7ec3cac4-4079-416c-a058-77febbb6a04d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:25 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-7ec3cac4-4079-416c-a058-77febbb6a04d" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:25 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Delete snapshot completed successfully.
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-efed1325-550f-4bde-b0a0-b2d1257002cd tempest-CinderUnicodeTest-764299876 None] Lock "cinder-5cf193ae-9347-4197-bc18-b9bb487a4092-delete_snapshot" released by "delete_snapshot" :: held 5.889s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7ec3cac4-4079-416c-a058-77febbb6a04d" acquired by "delete_volume" :: waited 0.023s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1eb12a-3537-44e6-9388-177549a64a32]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:25 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:26 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d" returned: 0 in 0.913s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac6bea2-91bf-43ce-8081-032c93b52e3d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7ec3cac4-4079-416c-a058-77febbb6a04d" returned: 0 in 0.259s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:26 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7ec3cac4-4079-416c-a058-77febbb6a04d" released by "delete_volume" :: held 1.403s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:27 devstack quobyte-client[83978]: System call of process 101029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:27 devstack quobyte-client[83978]: System call of process 101029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:27 devstack quobyte-client[83978]: System call of process 101029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" returned: 0 in 0.679s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['7dabc2dd-dffa-4c3a-b2fc-e9ff3d1b1576', '929c78b4-f92b-43a0-a32f-d92522b4b3fb', 'a61f77bf-03eb-497c-b832-454da0b3613c', 'c92a43a8-339d-4c42-9200-513499757fce'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" returned: 0 in 0.343s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa" released by "delete_volume" :: held 1.417s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:27 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.251s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:28 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-84c3a898-32c4-4c1b-8c43-aa1f1abb3566 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-7ec3cac4-4079-416c-a058-77febbb6a04d-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Created reservations ['823f9f80-ce57-4c41-83e1-c3f8586bc298', 'd69de694-d6bb-463f-9c15-4f974cc6e112', 'aa338fe0-6620-45a0-958f-2be8f2cdb83e', '0655da58-1b0c-428b-8e52-431ef9fb9436'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:28 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.252s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:29 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Deleted volume successfully.
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-5d370e1a-1b8f-410e-a186-f4cc93c1dfef-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-816bba19-1f02-42a3-84dc-34287d83f05b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-5d370e1a-1b8f-410e-a186-f4cc93c1dfef-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-9f30a904-d4a8-4ada-a2b3-ef8b26a13494 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-c511ac2d-8d28-46d0-b4a9-b2b790ac85aa-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-816bba19-1f02-42a3-84dc-34287d83f05b-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:29 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "cinder-quobyte-816bba19-1f02-42a3-84dc-34287d83f05b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" acquired by "delete_volume" :: waited 0.035s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-816bba19-1f02-42a3-84dc-34287d83f05b" acquired by "delete_volume" :: waited 0.043s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e766ad-f999-4bc5-9503-62768aa99e70]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a88307-3fbe-48f5-bedf-cb7cfa4c163e]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:29 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" returned: 0 in 0.619s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:30 devstack quobyte-client[83978]: System call of process 101037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:30 devstack quobyte-client[83978]: System call of process 101037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" returned: 0 in 0.177s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-5d370e1a-1b8f-410e-a186-f4cc93c1dfef" released by "delete_volume" :: held 1.012s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b" returned: 0 in 0.995s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:30 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-816bba19-1f02-42a3-84dc-34287d83f05b" returned: 0 in 0.390s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-quobyte-816bba19-1f02-42a3-84dc-34287d83f05b" released by "delete_volume" :: held 1.708s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['6d19a192-500b-472b-9c9f-e72cad5cbde7', '1a625e34-0bf0-473c-8818-3b3f6dceb24d', '797ae2f0-1f22-4d3a-a548-43e9a70b3bdf', 'af88952d-fa50-4b24-91c3-1c212505438d'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Created reservations ['352e1d35-3666-4c60-b928-e3bb6bd959e9', 'e8fde35c-7d9a-4466-b99d-0266f4f7d6ac', '348ba006-289e-45b5-8fc0-308dc4d12799', 'c414e4d4-d2f4-4b52-813f-2b921d8e2a71'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:31 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.288s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:32 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-a70356ec-eae3-4025-a2b4-8b51368801cf tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-5d370e1a-1b8f-410e-a186-f4cc93c1dfef-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:32 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.741s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:33 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Deleted volume successfully.
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-478342dd-8f25-4f1c-90d1-b97a29694ee8 tempest-CinderUnicodeTest-764299876 None] Lock "cinder-816bba19-1f02-42a3-84dc-34287d83f05b-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:33 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" acquired by "delete_volume" :: waited 0.021s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f8cf2-b8fa-43dc-b4c0-00186b76972d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:33 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" returned: 0 in 0.620s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" returned: 0 in 0.155s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b" released by "delete_volume" :: held 1.018s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['cc57d092-d278-4f4a-8533-08abe82f84d1', '6f95859f-93bb-4eaf-bb82-9485764b3910', 'e5615c6d-429b-445b-8339-bdbaf59f177d', '5a34ef14-3256-4ae0-9fde-9b6673033b3a'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:34 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.147s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:35 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-8b4b5d2c-987b-45c0-97f2-46d768acf01d-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-8b4b5d2c-987b-45c0-97f2-46d768acf01d-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-1f10af28-dee3-4254-9545-426fa2ff34f9 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-fa3fd62a-f794-4cc0-bd14-345b2ce0dd6b-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:35 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-8b4b5d2c-987b-45c0-97f2-46d768acf01d" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-8b4b5d2c-987b-45c0-97f2-46d768acf01d" acquired by "delete_volume" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[444d126e-b743-445c-8f40-b57ecbde68cc]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:35 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d" returned: 0 in 0.655s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:36 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-8b4b5d2c-987b-45c0-97f2-46d768acf01d" returned: 0 in 0.111s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:36 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-8b4b5d2c-987b-45c0-97f2-46d768acf01d" released by "delete_volume" :: held 0.970s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:36 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['38fba1b7-fa03-4003-9411-4a2b0a5c59ea', 'ab3acc57-8ffb-41af-a422-fa67b7292d99', '8bec5827-54d4-4b38-af01-a58b270aa37d', '4be56a07-84aa-4788-8eed-2d45daaf4f4f'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.116s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:37 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-8cc692b6-3a46-4e30-821e-114b14a57c76 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-8b4b5d2c-987b-45c0-97f2-46d768acf01d-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:37 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Flow 'volume_create_manager' (f5f996cb-1cbf-4718-aa58-cc976a3046f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0013ec1-55dd-42a6-b8d2-cd9b223d561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0013ec1-55dd-42a6-b8d2-cd9b223d561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1380975512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0cd356-9dcd-463d-bc6f-86ff4eb9c486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3c5f640e1f483d82ef2d0f65911506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:37Z,use_quota=True,user_id='3fa2866e5e104b5c9c19d834a031bc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871beeaa-528b-4fd9-aeea-317f75bccbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871beeaa-528b-4fd9-aeea-317f75bccbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff30e3d-d3f8-4d3d-84ae-7467bb7e0305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff30e3d-d3f8-4d3d-84ae-7467bb7e0305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0cd356-9dcd-463d-bc6f-86ff4eb9c486', 'volume_name': 'volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5148b1d4-ec13-4bde-8cbd-1e926c8d4b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5148b1d4-ec13-4bde-8cbd-1e926c8d4b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a86930-f718-4801-82e5-611ce0c345f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:37 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Volume bb0cd356-9dcd-463d-bc6f-86ff4eb9c486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486', 'volume_size': 1}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f979139be80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1380975512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0cd356-9dcd-463d-bc6f-86ff4eb9c486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3c5f640e1f483d82ef2d0f65911506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:37Z,use_quota=True,user_id='3fa2866e5e104b5c9c19d834a031bc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)}" {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Creating volume bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:37 devstack cinder-volume[83952]: INFO cinder.volume.drivers.remotefs [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] casted to 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2
Sep 25 20:11:37 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 1073741824 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:38 devstack quobyte-client[83978]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-503dfc6c-e90b-4e45-9994-93fee78950f7-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:38 devstack quobyte-client[83978]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:38 devstack quobyte-client[83978]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:38 devstack quobyte-client[83978]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:38 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=170, name=volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-503dfc6c-e90b-4e45-9994-93fee78950f7-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 1073741824" returned: 0 in 0.471s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.297s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:38 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-503dfc6c-e90b-4e45-9994-93fee78950f7" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'} {{(pid=83952) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-503dfc6c-e90b-4e45-9994-93fee78950f7" acquired by "delete_volume" :: waited 0.087s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd80c1-9473-4d7b-8634-502acb68fe3a]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:38 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a86930-f718-4801-82e5-611ce0c345f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486', 'volume_size': 1}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd548632-f7a3-48f2-8ec8-f47e1d428920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:39 devstack quobyte-client[83978]: System call of process 101061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:39 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Volume volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 (bb0cd356-9dcd-463d-bc6f-86ff4eb9c486): created successfully
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd548632-f7a3-48f2-8ec8-f47e1d428920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Flow 'volume_create_manager' (f5f996cb-1cbf-4718-aa58-cc976a3046f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7" returned: 0 in 0.542s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-503dfc6c-e90b-4e45-9994-93fee78950f7" returned: 0 in 0.219s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:39 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-f27c63a0-f982-4615-a30e-bfa6f7884cf5 tempest-SnapshotDependencyTests-1118446063 None] Created volume successfully.
Sep 25 20:11:39 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-503dfc6c-e90b-4e45-9994-93fee78950f7" released by "delete_volume" :: held 0.928s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:40 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['304f5bc8-71da-431a-8aa3-cb6c5b1c4cea', '9426ccd4-fbd4-4589-9524-a4e9bd14d70c', '29a8a914-1e5c-4608-9eaf-5c10100efc27', '539e26c7-b3bf-4144-8bfb-0c1acb2ea5bf'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-a76fff17-ad03-49ec-afb2-d53e984faa5a-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.461s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:41 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-a76fff17-ad03-49ec-afb2-d53e984faa5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.150s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-a76fff17-ad03-49ec-afb2-d53e984faa5a" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:41 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-a76fff17-ad03-49ec-afb2-d53e984faa5a" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleting offline snapshot a76fff17-ad03-49ec-afb2-d53e984faa5a of volume 7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] snapshot_file for this snap is: volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Creating offline snapshot 1560484f-dd7b-4d07-a907-12c4221add9e of volume bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018a513-d396-473d-8ff3-4daee2d81b40]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a87503-15a4-4be8-9aba-d423e21534f8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:41 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-bbc1e0a5-90d2-4067-bbcb-b0f368d78537 tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-503dfc6c-e90b-4e45-9994-93fee78950f7-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:42 devstack quobyte-client[83978]: System call of process 101066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.538s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec5d88f-c26e-4523-b68b-67d5d6ea9d5c]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:42 devstack quobyte-client[83978]: System call of process 101067 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:42 devstack quobyte-client[83978]: System call of process 101067 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.645s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e 1G {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:42 devstack quobyte-client[83978]: System call of process 101073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:42 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=171, name=volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e 1G" returned: 0 in 0.274s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:42 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:42 devstack quobyte-client[83978]: System call of process 101071 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb" returned: 0 in 0.588s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "qemu-img rebase -u -b volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 -F qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.236s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack quobyte-client[83978]: System call of process 101081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:43 devstack quobyte-client[83978]: System call of process 101081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:43 devstack quobyte-client[83978]: System call of process 101081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:43 devstack quobyte-client[83978]: System call of process 101081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.121s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Setting permissions: /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 -> 1000:1000 {{(pid=83952) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.331s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.177s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb.a76fff17-ad03-49ec-afb2-d53e984faa5a" returned: 0 in 0.195s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-a76fff17-ad03-49ec-afb2-d53e984faa5a" released by "_delete_snapshot" :: held 2.007s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.info" returned: 0 in 0.206s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.info is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.info {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:43 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" released by "delete_snapshot" :: held 2.211s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.info" returned: 0 in 0.356s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-da1d3abb-40d2-45d8-9721-d9e532896b88 tempest-SnapshotDependencyTests-1118446063 None] Create snapshot completed successfully
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['85ceb44a-0e0a-4d5c-9b10-fd838bb50928', 'fe3f3f2e-ec53-4803-a2ef-bf4bea55aefb', '516afe6e-7f7b-4763-8d60-126b40452019', 'a5b9d74c-4de4-428b-9098-6c6e357e30b8'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:44 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Delete snapshot completed successfully.
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-083da283-3b28-484c-95ee-5f6c00861efa tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-a76fff17-ad03-49ec-afb2-d53e984faa5a-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-7e4ce886-15e3-49f1-a8dc-76274d223ceb-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-7e4ce886-15e3-49f1-a8dc-76274d223ceb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:44 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" acquired by "delete_volume" :: waited 0.013s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67be69b-46f3-4a1e-92e4-dd5ac417874f]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:44 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:45 devstack quobyte-client[83978]: System call of process 101089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb" returned: 0 in 0.706s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:45 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG cinder.volume.flows.manager.create_volume [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83952) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-7e4ce886-15e3-49f1-a8dc-76274d223ceb" returned: 0 in 0.330s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-quobyte-7e4ce886-15e3-49f1-a8dc-76274d223ceb" released by "delete_volume" :: held 1.142s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:45 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Flow 'volume_create_manager' (2e136944-8543-4f1f-82e7-2b11db457af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ff529d-d9b3-4f0c-97c6-ed2af51d9a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ff529d-d9b3-4f0c-97c6-ed2af51d9a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-25T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b29c8c-4001-40aa-bcd0-690fec0ce7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3c5f640e1f483d82ef2d0f65911506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-25T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1560484f-dd7b-4d07-a907-12c4221add9e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-25T18:11:45Z,use_quota=True,user_id='3fa2866e5e104b5c9c19d834a031bc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f),volume_type_id=c8c0bdb9-64a7-4c6f-aca4-cf288eb3cd6f)' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de029c7b-2bb9-4a2a-aa83-475221455569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de029c7b-2bb9-4a2a-aa83-475221455569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c47e6-fbab-4f05-abc5-5df384dff811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c47e6-fbab-4f05-abc5-5df384dff811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50b29c8c-4001-40aa-bcd0-690fec0ce7cd', 'volume_name': 'volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd', 'volume_size': 1, 'snapshot_id': '1560484f-dd7b-4d07-a907-12c4221add9e'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59050fe2-2b4b-47a4-91c1-69e6279d728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59050fe2-2b4b-47a4-91c1-69e6279d728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52169a6-c8de-4e1a-b740-8457cfa0fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:46 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Volume 50b29c8c-4001-40aa-bcd0-690fec0ce7cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd', 'volume_size': 1, 'snapshot_id': '1560484f-dd7b-4d07-a907-12c4221add9e'}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" by "_create_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Creating volume 50b29c8c-4001-40aa-bcd0-690fec0ce7cd from snapshot 1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Selected 10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2 as target Quobyte volume. {{(pid=83952) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" by "_copy_volume_from_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] snapshot: 1560484f-dd7b-4d07-a907-12c4221add9e, volume: 50b29c8c-4001-40aa-bcd0-690fec0ce7cd,  {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[48885ebb-5db5-4a0b-9474-7b24e1355dac]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Created reservations ['e37a81b3-f0a8-4adf-bda1-7d6074eb12a1', '123c0e95-bff2-461a-b1f8-edfc94913eb6', '19b29729-9726-4205-9eb1-a261a688b1ae', '9a0eda81-4ec3-47cb-8c09-0018aa33e895'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:46 devstack quobyte-client[83978]: System call of process 101093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.538s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Creating direct copy from snapshot {{(pid=83952) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef3cde4-a272-4c68-b058-c311717d8ee2]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:46 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.128s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:47 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Deleted volume successfully.
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.825s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG cinder.utils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd not found in is_blk_device check {{(pid=83952) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 25 20:11:47 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:47 devstack quobyte-client[83978]: System call of process 101101 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:47 devstack quobyte-client[83978]: System call of process 101101 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:48 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-5c75afaa-6722-46e0-b2cb-598525b9728b tempest-CreateVolumesFromSnapshotTest-1147534834 None] Lock "cinder-7e4ce886-15e3-49f1-a8dc-76274d223ceb-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:48 devstack quobyte-client[83978]: The server volume:fbe9f9d9-f281-4896-b740-dea897615145@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fbe9f9d9-f281-4896-b740-dea897615145, inode=173, name=volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.86), requestorAccessMask=0
Sep 25 20:11:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" returned: 0 in 6.038s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:53 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ae3d4-d90f-4b06-ab65-29fc885a46e3]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:53 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:54 devstack quobyte-client[83978]: System call of process 101119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:54 devstack quobyte-client[83978]: System call of process 101119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:54 devstack quobyte-client[83978]: System call of process 101119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.664s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.image.image_utils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Image conversion details: src /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd {{(pid=83952) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 25 20:11:54 devstack cinder-volume[83952]: INFO cinder.image.image_utils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Converted 1024.00 MB image at 169.39 MB/s
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] File path /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd is being set with permissions: 660 {{(pid=83952) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" returned: 0 in 0.179s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" released by "_copy_volume_from_snapshot" :: held 8.485s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" released by "_create_volume_from_snapshot" :: held 8.578s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.604s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_service.periodic_task [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83952) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:54 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.232s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-b1459fcf-5f5c-4d3f-b86c-44efefbe7e69 None None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52169a6-c8de-4e1a-b740-8457cfa0fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd', 'volume_size': 1, 'snapshot_id': '1560484f-dd7b-4d07-a907-12c4221add9e'}' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f61890d-c580-466b-a626-5b8169f2eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 25 20:11:55 devstack cinder-volume[83952]: INFO cinder.volume.flows.manager.create_volume [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Volume volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd (50b29c8c-4001-40aa-bcd0-690fec0ce7cd): created successfully
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f61890d-c580-466b-a626-5b8169f2eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83952) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Flow 'volume_create_manager' (2e136944-8543-4f1f-82e7-2b11db457af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83952) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 25 20:11:55 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-550c121b-7f53-45c6-92b3-3a75eddceed9 tempest-SnapshotDependencyTests-1118446063 None] Created volume successfully.
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-1560484f-dd7b-4d07-a907-12c4221add9e-delete_snapshot" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-1560484f-dd7b-4d07-a907-12c4221add9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:55 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" by "delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e" by "_delete_snapshot" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Deleting offline snapshot 1560484f-dd7b-4d07-a907-12c4221add9e of volume bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] snapshot_file for this snap is: volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c288c3-76fb-4160-ae47-da91c7b786a8]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:55 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.396s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.remotefs [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83952) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8506bd-2c10-4f71-8fd5-161176dd7f7d]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:56 devstack quobyte-client[83978]: System call of process 101127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.436s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:56 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:57 devstack quobyte-client[83978]: System call of process 101130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:57 devstack quobyte-client[83978]: System call of process 101130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.227s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486.1560484f-dd7b-4d07-a907-12c4221add9e" returned: 0 in 0.089s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-1560484f-dd7b-4d07-a907-12c4221add9e" released by "_delete_snapshot" :: held 1.450s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" released by "delete_snapshot" :: held 1.482s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Created reservations ['e286c0e1-534a-4afe-9ad1-7c696d58e69d', '9dfd66af-5cf1-4200-98ec-416cd8b5e143', '74df7170-c253-4a09-b0b1-1169bb5305b4', '1c4058a4-42b0-40ea-99bc-7c2a148d7337'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:57 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Delete snapshot completed successfully.
Sep 25 20:11:57 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-ba49bc75-3213-4107-a920-736ac1afeb0f tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-1560484f-dd7b-4d07-a907-12c4221add9e-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:58 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b94c2-f33d-4cd8-893e-2b513800ef36]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:58 devstack quobyte-client[83978]: System call of process 101135 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.537s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:58 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" returned: 0 in 0.139s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486" released by "delete_volume" :: held 0.928s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Created reservations ['2d7076de-cfd9-4e51-8022-c8c1054ecf3d', '52f95e5a-5eb0-4f43-9a90-01e395456daa', 'd3c6d0cd-51b4-4055-ae6f-8e03f513b6c7', '58f7229c-85f0-4783-b6e3-bd5c1d0c48d6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.092s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:11:59 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Deleted volume successfully.
Sep 25 20:11:59 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-0795e51b-1c56-4aa5-87a8-1303e2bfdcc0 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-bb0cd356-9dcd-463d-bc6f-86ff4eb9c486-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-50b29c8c-4001-40aa-bcd0-690fec0ce7cd-delete_volume" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-50b29c8c-4001-40aa-bcd0-690fec0ce7cd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:12:00 devstack cinder-volume[83952]: WARNING cinder.volume.volume_utils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" by "delete_volume" {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" acquired by "delete_volume" :: waited 0.017s {{(pid=83952) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG oslo.privsep.daemon [-] privsep: reply[262604d2-0f67-4424-be9c-7594f304aaa3]: (4, 'qcow2') {{(pid=85073) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 25 20:12:00 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" returned: 0 in 0.403s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] CMD "rm -f /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43/volume-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" returned: 0 in 0.105s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-quobyte-50b29c8c-4001-40aa-bcd0-690fec0ce7cd" released by "delete_volume" :: held 0.663s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG cinder.quota [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Created reservations ['b7aec390-8045-4381-a58e-6f809936ddd5', '18a45b40-6778-4764-a3c0-aaa32667d19d', '5069e048-f4ed-43e0-bb41-f885209bf00c', '336d401f-a9b2-4bc4-919c-0e56d8b6b1f6'] {{(pid=83952) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2': None} {{(pid=83952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG cinder.volume.drivers.quobyte [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Available shares ['10.10.41.181/cinder-vol-3a785822-4449-47d5-8a90-fbb0dd4750a2'] {{(pid=83952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.lockutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83952) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43 {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG oslo_concurrency.processutils [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8698c69aad50d2a4677bf1261021aa43" returned: 0 in 0.081s {{(pid=83952) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 25 20:12:01 devstack cinder-volume[83952]: DEBUG cinder.manager [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Notifying Schedulers of capabilities ... {{(pid=83952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 25 20:12:01 devstack cinder-volume[83952]: INFO cinder.volume.manager [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Deleted volume successfully.
Sep 25 20:12:02 devstack cinder-volume[83952]: DEBUG cinder.coordination [None req-6daf6932-d222-4386-a487-b8beab262114 tempest-SnapshotDependencyTests-1118446063 None] Lock "cinder-50b29c8c-4001-40aa-bcd0-690fec0ce7cd-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83952) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 25 20:12:11 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=122,cinder:DELETE=4,cinder:SELECT=71,cinder:INSERT=30 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 25 20:12:11 devstack cinder-volume[83952]: DEBUG dbcounter [-] [83952] Writing DB stats cinder:UPDATE=89,cinder:DELETE=12,cinder:SELECT=67,cinder:INSERT=22 {{(pid=83952) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}